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ABSTRACT 


This thesis analyzes the Academic Review Process (ARP) 
at the Hospital Corps “A” School, specifically focusing on 
how it is working and the criteria of the Academic Review 
Board. This was accomplished by analyzing a data 
spreadsheet of students that went through the ARP in 2003 
and a survey randomly administered to a general student 
sample in January 2004. The study identified and analyzed 
the perceptions of students, instructor staff, and 
headquarters staff in the evaluation of the processes; 
analyzed a student data set by cross-referencing the 
recommendation and final disposition results of those that 


entered the ARP; and developed a cost framework for the 





command and future researchers to help determine the 











effectiveness of the process. The report includes 


recommendations for improving the ARP process. 
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a INTRODUCTION AND BACKGROUND 


A. INTRODUCTION 


The capacity to sustain readiness is one of the most 
important challenges facing the Navy today. Readiness is 
continually affected by personnel shortages, increased 
operational commitments, diminishing budgets and advanced 
technology, all of which affect the quantity and quality of 
people the Navy will need. Determining the appropriate 
quality and the quantity mix is very important in today’s 
military environment. Attracting people with the right 


skills is a crucial element to the success of readiness. 


The system responsible for sustaining fleet and shore 
personnel readiness is the Navy Manpower, Personnel and 
Training (MPT) System. The MPT system is divided into four 


processes: Manpower Requirements, Manpower Programming, 





Personnel Distribution, and Personnel Planning (BUPERS Web 





page). Manpower Requirements and Manpower Programming 
processes concentrate primarily on what is vital for each 
ship, squadron and shore command to operate efficiently. 
Personnel Planning and Personnel Distribution processes 
focus on who will fill shore and fleet personnel 
requirements. Recruiting and training facilitate the 
process of putting “the right person in the right place at 
the right time” (BUPERS Web page). 


The recruiting and training processes are vital to 
meeting mission requirements and sustaining readiness. 


Commander, Navy Recruiting Command (CNRC), Millington, 





Tennessee recruits over 40,000 men and women each year. 
Chief, Naval Education and Training Command (NETC) is 


1 


responsible for training Sailors. It is estimated that 


over 43,800 students are in training each day (BUPERS Web 
page). 


The process of transforming a citizen into a Sailor 
can be broken down into two phases: the recruitment phase 
and the training phase. The recruitment phase begins when 
a recruiter makes contact with a potential recruit. After 
contact is made and interest is exhibited, the recruiter 
conducts background, moral, financial, and educational 
checks, and the Armed Forces Vocational Aptitude Battery 


(ASVAB) test is administered. 


During the last stage of the recruitment phase, 
individuals receive their ship dates to Recruit Training 
Command (RTC). Many individuals ship directly to recruit 


training, while others enter the Delayed Entry Program. 





The final aspect of recruiting occurs when recruits are 


sworn in (or when recruits take the enlistment oath). 


Military occupation training begins with assignment to 
Initial Skills Training (IST). This usually occurs at RTC. 
The goal of IST is to introduce Sailors to military- 
specific skills. Each student must meet the minimum 


entrance requirements established by Congress and the 





Department of Defense. 


To predict quality in training and job performance, 
personnel planners use education levels and Armed Forces 
Qualification Test (AFQT) scores. Recruiters make every 
effort to enlist AFQT Category I-IIIA (50° percentile and 
above on the AFQT) test-takers (Cymrot, 2001). Research 





suggests that high school diploma graduates are more likely 


to complete their enlistment, and that higher AFQT-scoring 
2 





recruits perform better in training and on the job (Moore 
and Reese, 2001). Thus, “the overall process of putting 
the right person in the right place at the right time is 
not complete until Sailors are assigned to jobs that fully 
utilize their acquired occupational skills” (BUPERS Web 
page). 
B. BACKGROUND 

Upon entering Naval Service, most enlisted personnel 
do not possess the necessary skills to perform their 
assigned jobs effectively. The reason for this is two- 


fold: 1) in most cases members are coming directly from 





high school, and 2) most have never been exposed to 
specific job training. To combat this problem, the Navy 
provides IST. The goal of this training is to introduce 


and prepare Sailors for their initial military jobs. 


To meet operational requirements, policy makers must 
predict: 1) the number of qualified Sailors in the 
pipeline, and 2) the length of time required for Sailors to 
successfully complete IST. Thus, various processes are in 
place at training commands to manage remediation and, if 


necessary, attrition. 


This research focuses on the Academic Review Process 
(ARP) at the Basic Hospital Corps School. Located in Great 
Lakes, Illinois, the mission of the Basic Hospital Corps 
School is “to provide leadership, education and training, 
to prepare and qualify enlisted personnel to perform as 
Basic Navy Hospital Corpsmen in support of the mission of 


the United States Navy and Marine Corps” (NHCSGLAKES Web 





page). As shown in Figure 1, the average yearly throughput 


for the past five years has been 3,100 students; of those 


3 


students, approximately six percent each year attrite while 


in Basic Hospital Corps School. 





























Hospital Corpsman Attrition 
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Figure 1. Hospital Corpsman Attrition. 


From Grefer, J., Wartime Medical Requirements, CNA, 2001. 

Upon completion of school most students are assigned 
to hospitals or clinics. Others work aboard ships or 
submarines, air squadrons, or special operational 


environments (e.g., Seabee Units and Deep Sea Diving). 





Duties assigned are service-oriented, repetitive, and 
require good judgment. Hospital Corpsmen may work alone or 
with supervision by other healthcare professionals, 


depending on their assignments. 


The Hospital Corps School receives guidance from NETC 
regarding training-related issues. The school’s executive 
chain of command is the Commanding Officer (CO), the 
Executive Officer (XO), and the Director of Academics 
(DAD). The DAD is responsible for the administration and 


performance of the school. 


1. Student Qualifications 


Students must meet the minimum Armed Forces Vocational 
Aptitude Battery (ASVAB) score of: Sum of Word Knowledge 
and Paragraph Comprehension (VE) + Mathematics Knowledge 
(MK) + General Science (GS) = 149, out of a possible total 
score of 320. The average AFQT for HM recruits is 74, and 
82.8 percent are in AFQT Categories I-IIIA (MILPERSMAN, 
2003). Further, students must demonstrate high standards 
of behavior before accession into the HM community. For 
instance, a student may not have a history of drug abuse or 
have committed any offenses involving the abuse of alcohol, 
narcotics, or other controlled substances. 

2. Curriculum 

Group and modular instruction are used to teach 
students the fundamentals of the HM rating, including basic 
principles and techniques of patient care and first aid 
procedures. Students receive 560 hours of classroom 
instruction and 80 hours of clinical time. Fourteen written 
exams and 16 comprehensive skill laboratories cover the 
following areas: basic life support (BLS), vital signs, 
airway management, patient assessment, cardiac emergencies, 
bleeding and soft tissue injury, muscular and skeletal 
injuries, head and spine, surgical asepsis, oral 
medications, intramuscular (IM) subcutaneous (SC) 
injections, venipuncture, patient lifting and moving, 
urinary catheterization, mass casualties, and IV therapy. 
In addition, the curriculum is recommended for 15 hours of 
undergraduate credit through the Academic Council on 
Education (ACE) and is accredited by the Commission of the 


Council on Occupational Education (NHCSGLAKES Web page). 


3% Academic Review Process 


The Academic Review Process (ARP) was established to 
monitor students who may experience academic and non- 
academic problems. The first test failure requires 
students to be counseled by a member of the instructional 
team. The instructional team consists of a Chief Hospital 
Corpsman (HMC), a Hospital Corpsman First Class Petty 
Officer (HM1), and a Hospital Corpsman Second Class Petty 
Officer (HM2). After a second test failure a student is 
counseled by the instructional team leader and automatically 
assigned to night study. The instructional team leader is 
the division officer (DIVO). After the third test failure 
the student must appear before an Academic Review Board 


(ARB). The function of the ARB is to make a recommendation 





to retain and reclassify, setback, or remove the Sailor 


from training. 


At the Hospital Corps School, the ARB is convened under 
the authority of the CO (NAVHOSPCORPSCOLINST, 2002). The 
ARB membership consists of three members. The Chair can be 
a Division Officer (DIVO), an Educational Support Services 
Officer (ESSO), a Support Services Officer (SSO), an 
Instructional Services Support Officer (ISSO), or another 
officer designated by the DAD. The other two members must 
have instructional experience and must be senior to the 
student being reviewed. For example, a Petty Officer Third 
Class cannot sit as a member of the board if the student 
being reviewed is the same rank (NAVHOSPCORPSCOLINST, 2002). 
Members cannot sit on a board if they are part of the 
advisory team, or if they are responsible for completing 


student reclassification actions. 





Students are interviewed by board members to determine 
their motivation, desire, and commitment to complete the 


training. To receive a recommendation of retention and 





setback, board members must feel the student has both the 

ability to successfully complete the school program and the 
determination to do so. Regulations state that if the ARB 
recommends disenrollment it must further recommend that the 


student be either transferred directly to the fleet 





(GENDET), reclassified for another rating, or separated from 
the service (NAVHOSPCORPSCOLINST, 2002). The CO makes the 
final decision based on the contents of the ARB package 
(e.g., interview notes, test scores) and the recommendations 
of the ARB, DAD, and XO. 

GC: RESEARCH QUESTIONS 


This thesis explores the ARP at the Basic Hospital 





Corps School, including the effectiveness of the process in 
helping students successfully complete IST. The following 
research questions are addressed: 


Primary research questions 

e What is the Academic Review Process (ARP) and how 
is the Academic Review Process working? 

e What are the criteria of the Academic Review 
Board? 


Secondary research questions 


e What are the strengths and weaknesses of the ARP? 
e What is done to promote student success? 

° What is helping students the most? 

e Are there ways to improve the process? 

e How are decisions made? 

e Which level of the decision-making process is 


most accurate in predicting student success? 


e What are the economic costs and benefits of the 
ARP ? 


D. SCOPE AND LIMITATIONS 


Data for this thesis were limited to students and 
staff who were involved in the academic review process in 
Fiscal Year 2003. The data do not capture students who 
were involved in the process but then were subsequently 
disenrolled. 


E. ORGANIZATION OF STUDY 


Chapter II reviews the literature applicable to 
understanding IST attrition. Chapter III describes the 
research methodology used to collect and analyze the data. 
Chapter IV provides the qualitative and quantitative 
analyses of the structured interviews and questionnaire 
data gathered for this study. In addition, this chapter 
presents the results of the analysis of a database of 
students who were involved in the ARB during 2003. Finally, 
chapter IV provides the framework for computing the cost of 
setbacks and disenrollments, and presents how errors based 
on the CO’s decision increases the cost of student 
throughput. Chapter V presents overall conclusions of the 
study and recommendations for improving the academic review 


process. 


II. LITERATURE REVIEW 


A. DEFINING ATTRITION 


The Collins English Dictionary defines attrition as 


the “wearing down of something” (World Reference Web page). 





In the context of personnel management, attrition wears 
down the quantity and quality of personnel in the fleet. 
For the past decade, attrition rates for all services have 
remained within a broad band, ranging from around 25 
percent to 40 percent (Gebicke, 1997). From a service- 
specific perspective, in general the Army’s attrition rate 


has been the highest and the Air Force’s the lowest. CNA’s 





1999 study reported findings of increased pre-fleet and 





first-term attrition in the Navy (Belcher, Reese, and 
Lewis, 1999). Since that finding was published, the Navy 
has focused much of its attention on implementing 
initiatives that will improve delivery of recruits to the 


fleet (Lien and Reese, 2002). 


Attrition occurs when an enlistee leaves military 





service before the end of his or her contracted enlistment 
term. Pre-fleet attrition occurs when an enlistee fails to 
successfully complete recruit training or initial skills 
training; first-term attrition occurs when a Sailor makes 
it to a full-duty billet in the fleet but separates before 


the end of his or her contract. 


Attrition can occur in several different ways. It can 
occur through involuntary separation at the convenience of 


the Navy or through voluntary separation at the convenience 





of the individual. There are three major categories of 
attrition: (1) separations for medical/physical problems, 
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either for medical conditions that existed prior to 
service, or for physical problems that develop while 


enlistees are in training; (2) separations for fraudulent 





or erroneous enlistment, indicating either that the service 
did not detect the disqualifying conditions prior to their 


enlistments or the enlistees deliberately withheld 





disqualifying information; and (3) separations for 
performance problems, such as failure of the physical 
training test, misconduct, exceeding weight and body fat 
standards, character and behavior disorders, alcoholism, 
drug use, homosexuality, loss of motivation, or inability 
to adapt to military life (Cymrot, Golding, & Parcel, 
2001). Figure 2 shows that of 52,000 recruits, over 10,000 
potential Sailors attrited during their pre-fleet training, 
and over 7,000 suffered first-term attrition (Alderton, 
2002). Pre-fleet and first-term attrition have far- 
reaching consequences, such as wasted investment in 
training, time, and equipment. More importantly, attrition 


reduces the number of trained Sailors who enter the fleet. 








Lose 10,000+ in training Lose 7,500 + from Fleet 
60,000 
a0 41,900 
39,300 36,800 
40,000 9 35,200 34,400 
30,000 
20,000 
10,000 
0 
Total 12 mo 24 mo 36 mo 48 mo 
Recruits Training Fleet 
Figure 2. Accession Pipeline: Pre-Fleet and First-—Term 
Attrition. 
From Alderton, D., Selection and Classification for Enlisted Service, 2002). 


The original source is CNA [hces.bus.olemiss.edu/mas_v_2002.html], March 2004. 
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B. PRE-FLEET ATTRITION 


The results of numerous studies suggest that the 
predicted rate of first-term attrition is significantly 


affected by education, race, age, gender, and AFQT score. 





Many of these studies conclude that education level and 
AFQT score are most effective in predicting military job 
performance and attrition. An analysis of Army accession 


data from 1974-1983 revealed the first-term survival of 





high school graduates exceeded that of non-graduates by 15 
percent (Warner & Solon, 1991). This seems to be a 


consistent finding among services. 


Quester and Olsen (1988) examined all non-prior Navy 





service accessions (those with less than 180 consecutive 
days of active prior service) during 1978-1986. They found 
that the most important recruit characteristic for 
predicting attrition, performance, and retention beyond the 
first term is high school graduation. In Figure 3, the 
data collected on FY 95-98 accessions provide a further 
example that recruit quality matters. High school diploma 
graduates (HSDG) have significantly lower attrition rates 
than do non-HSDG throughout their initial terms of 
enlistment (Alderton, 2002). Attrition rates for HSDG 
range from 10.5 percentage points lower at the beginning of 
RTC to 25.6 percentage points lower at the end of three 


years of enlistment. 


lid. 


Percent Attritio1 
ost 8 BSBBA 





RTC 1Yr 2Yr 3 Yr 
Figure 3. Cumulative Attrition by Educational Credential. 
From Alderton, D., Selection and Classification for Enlisted Service, 2002). 


The original source is CNA [hces.bus.olemiss.edu/mas_v_2002.html], March 2004. 


1. Boot—Camp Attrition 


Studies of boot-camp attrition focus on recruit 
characteristics and successful adaptation to military life. 
The results of these studies suggest the most important 
characteristics for successful outcomes are: (1) 
educational credential; (2) A-cell (graduates who screen in 
top half of AFQT); and (3) entrance through the delayed 
entry program (DEP) (Quester, Macllvaine, Barfield, Parker, 


& Reese, 1998). 


To study accession quality, Quester et al., developed 
seven recruit quality cells based on the Navy’s historical 
success rates of recruits who attended boot camp during FY 
1994 through FY 1996 (Quester et al., 1998). As shown in 
Table 1, decreases in accession quality are related to 
increases in attrition. The historic boot-camp attrition 


rates were then used as a baseline to evaluate current boot 





camp attrition trends. The outcome supported findings in 
previous studies, with the largest attrition rates 
occurring for category 6 and 7 recruits -— non-HSDG 


graduates with low AFQT scores. 
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Factors Predicting Attrition Attrition Rate 
Percentages 
Category 1 AFQT I-II; HSDG; DEP 9.4 
Category 2 AFQT IIIA; HSDG, DEP 11,9 
Category 3 AFQT IIIB; HSDG; Direct Ship 14.4 
Category 4 AFQT I-IIIA HSDG; Direct Ship 13.9 
Category 5 AFQT IIIB; HSDG; Direct Ship 17.9 
Category 6 All AFQT; NHSDG; DEP 20.3 
Category 7 All NHSDG; Direct Ship 24.1 
Table 1. Factors Predicting Attrition. 


Using the attrition data from their previous study, 
these authors calculated the number of days that it took 
for recruits to attrite from boot camp. They found that 
three percent of recruits attrited after one to ten days in 
the Navy; 37% attrited after 11-20 days; 27% attrited after 


21 to 30 days; and ten percent attrited after 60 or more 





days in the Navy. The researchers described two 
implications of the findings: (1) there are procedures in 
place at boot camp that can promptly identify future 


attrites; or (2) current screening procedures are not 





effective. The researcher also raised an important 


question: In the cases where attrition occurred within a 





few days, was enough time spent with recruits to fully 


evaluate their potential? (Quester et al., 1998). 


Some less prevalent factors impacting boot-—camp 
attrition include misconduct, inability to maintain weight 
standards, character and behavior disorders, alcoholism, 
and homosexuality. (Gebicke, 1997). In addition, studies 
have found that while recruits with waivers have a somewhat 


higher attrition rate than those recruits without waivers, 
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they are not among those considered to be a very high 


attrition risk (i.e., NHSDG and low aptitude scores). 


Few studies have been conducted that examine recruits 
who successfully survive recruit training but attrite while 
in their initial training pipeline. In fact, this issue 
was not fully considered until the 1990s, when the Navy 
lost approximately 18 percent of its recruits to pre-fleet 
attrition (Cymrot, 2001). The focus of this research is to 
identify factors that may contribute to IST attrition by 
looking into the initial skills training program at the 
Naval Hospital Corps School. 


2. Initial Skills Training Attrition 


It could be said that the process of selection and 
classification for A-school has some problems. The rate of 


attrition from A-school has exceeded twenty percent from 





1993 to present (Moore & Reese, 2001). The Department of 
Defense spends between $9,400 and $13,500 to recruit and 
train an active-duty enlistee through basic training, with 
an additional $6,100 to $16,300 spent on initial skills 
training (GAO, 1997). In today’s military, this high level 
of attrition has the potential to be a significant 


detriment to fleet readiness. 





To gain a better understanding of the contributory 
factors leading to attrition of recruits who successfully 
complete boot camp, but subsequently attrite out of A- 
school, CNA conducted a study of 77,724 recruits who 
entered the Navy between FY 1993 and FY1998. The results 





of this study were similar to the results reported for 
previous boot-camp attrition studies in that education, 


waivers, and DEP were found to be important predictors of 
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IST completion(Moore & Reese, 2001). The study also found 
that rating assignment and student perception of rating, as 
well as school management and A-school curricula, were 


significant factors in explaining attrition. 





A recruit’s rating options are determined by matching 
available positions with the recruit’s projected success 
based on his or her aptitude. With no prior knowledge of 
the duties or responsibilities of the rating, the recruit, 
once introduced to the rating, may perceive it as 
unsuitable. This perception could lead to attrition. 
Changes related to school policy and curricula were found 
to have a negative impact on attrition (i.e., changes in 
weight control standards, disciplinary procedures, quality 
of trainers, difficulty of course work, or testing and 
grading criteria). The study also found a small but 
negative correlation between training time and attrition. 
The correlation could not be isolated to a specific reason. 


However, the study found that for each one-point increase 





in the percentage of time not under instruction (i.e., time 
spent awaiting training, awaiting transfer, and interrupted 
instruction) there is a corresponding 0.54 increase in 
attrition. There is speculation that longer training 
pipelines may have simply shifted attrition that was 
destined to occur in the fleet to a pre-fleet period (Moore 


& Reese, 2001). 


Another study of particular relevance to attrition 
examined what happens to the Sailors who fail an A-school 
course, but are allowed to continue in a different rating 
(Quester, Macllvaine, Barfield, Parker, and Reese, 1998). 


Sailors who were academic course failures, yet were allowed 
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to continue in a different A-school, experienced no further 
A-school attrition and were subsequently rated. In FY 
1993, 119 academic failures were reassigned and rated; 81 
percent completed 42 months of service. In comparison, 203 
non-academic failures were sent to the fleet as GENDETS 
(non-designated) and 57 percent completed 42 months of 


service. 


In FY 1994, 121 academic failures were reassigned and 
rated and 57 percent completed 42 months of service. In 
comparison, 262 nonacademic failures were sent to the fleet 
as GENDETS, and 56 percent completed 30 months of service. 


The results show that academic failures do better in the 





fleet than non-academic failures. The researchers noted in 
their study that they strongly support initiatives to 
provide a second chance at school. 


a. Managing Attrition 


Getting a second chance in military academic 
institutions is determined by the guidelines set forth in 
the Navy School Management Manual (NAVEDTRA 135A, 2000). 
The manual outlines informal measures to be taken for 
student pipeline management, such as preventative student 
counseling, remediation programs, retesting procedures, and 
initial academic setback. The manual also provides 
guidance and procedures for the Academic Review Board, 
which is a formal student pipeline management tool. The 
Academic Review Board is conducted within formalized 
procedures in handling non-disciplinary problems related to 
a student’s academic progress. The ARB is based on the 
philosophy “that decisions concerning a student’s drop from 


training are better arrived at by a group acting together 
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as a board rather than an individual acting alone” 


(NAVEDTRA 135A, 2000). This process requires the board to 





make assessments of a student beyond academic ability. 
Additional relevant factors include character, leadership 
ability, motivation, and other possible factors that could 


affect a student’s ability to complete training. 


A thesis study conducted in 1990 examined the ARB 
decision and reporting process of seven “A” schools. The 
study surveyed 91 ARB members and found the following 
inconsistencies in the ARB procedure: 1) inconsistencies in 
judgment as to what factors should be considered in the 
decision process; 2) lack of standardized criteria; 3) a 
difference in ARB procedures across schools, including 
differing setback polices governing how many times a 
student can recycle through training; and 4) a decision-— 
making bias of board members based on the school’s 


attrition rate (Firehammer, 1990). 


These inconsistencies in policies or standards 
can affect A-school attrition in such a way that the true 
nature of the problem is not revealed. If the ARB cannot 
be used to adequately assess the reasons that enlistees 


attrite, then it may be ineffective at reducing attrition. 





Thus, leaders may implement arbitrary procedures that might 
result in greater enlistee attrition. The implementation 
of standardized procedures, set criteria, evaluation tools, 
and reporting and tracking mechanisms will aid leaders in 
making assessments and capture historical data for future 


studies. 


Most of the research on school attrition has 


looked at the effects that student characteristics such as 
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ability and level of education have on academic attrition. 


As illustrated in Table 2, there have been several studies 





that have found other plausible factors that may lead to 
first-term attrition, such as leadership practices, 
differences in institutional policies, and better job 
opportunities. The focus of this research is to identify 
factors that may contribute to IST attrition by looking 
into the initial skills training program at the Naval 


Hospital Corps School. 


To conclude, there is obviously a problem with pre- 
fleet attrition in the military services. Studies 
referenced in this section have examined many different 
factors to identify those that have a causal effect on pre- 
fleet and first-term attrition. Common to all of the 
studies are aptitude and education factors. All of the 
studies found that recruits with a high school diploma and 


a high AFQT score were more likely to successfully complete 





their pre-fleet training and their first-term. Studies 





also found that there are other variables that influence 
pre-fleet attrition, including rating assignment, recruit 
perceptions, and schoolhouse management (to include the 
academic review process). A study examining pre-fleet 
attrition found that Sailors who were academic course 
failures, yet allowed to continue in a different A-school, 
experienced no further A-school attrition, and were 
subsequently rated. Further, the results show that 
academic failures do better in the fleet than non-academic 
failures. The study noted that initiatives that provide a 
second chance at school should be strongly supported. 


Understanding the causal factors associated with pre-fleet 
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attrition is vital to understanding the policies and 





changes needed to reduce pre-fleet attrition. 





Finding 


Reference 





Probability of quitting the service is higher 
among non-high school graduates, those with 
dependents, younger recruits, and those with a 
history of trouble. 


Stolzenberg and Winkler (1990) 





High school graduation is the best predictor 
of first-term attrition. Female recruits, 
especially those in non-traditional Military 
Occupational Specialties (MOS) have higher 
attrition rates. 


Ross, Nogami, and Eaton (1994) 





Psychological screening may be important in 
reducing attrition. 


Mael and Ashforth (1995) 





The affect of AFQT on first-term attrition 
varies by MOS, suggesting that better matching 
might help reduce attrition. 


Manganaris and Schmitz 1985) 





Women have higher attrition than men. 


Recruiting high quality recruits may add less 
to the productivity cost. 


Quester and Steadman (1990) 


Congressional Budget Office 
1986) 





Along with educational attainment, pre- 
enlistment work history, and temporal 
variables, attrition is strongly influenced by 
institutional policies. 


Doering and Gisshmer (1985) 





High school graduates have a lower probability 
of first-term attrition; minorities have lower 
attrition rates. 


Warner and Solon (1991) 





Recruit characteristics have an important 
effect on attrition. Thus initial screening 
can help reduce attrition. 


Buddin (1988) 





























Service policies and practices have an Buddin (1985) 
important effect on attrition. 

Better screening of enlisted personnel could GAO (1997) 

result in large savings. 

Pre-basic instruction in basic verbal literacy | Thomlison (1996) 
skills will reduce first-term attrition. 

A new series of experimental tests, measures, Manganaris and 
and non-cognitive characteristics could be Schmitz (1996) 

useful in screening individuals for 

occupations. 

Table 2. First-Term Enlistment, Attrition, and 


Performance Studies. 


From Kirby and Naftel, 
Literature, RAND 2001. 
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III. METHODOLOGY 


A. INTRODUCTION 


This chapter describes the data collected from the 
Basic Hospital Corps School, and discusses the analytic 
tools used to examine the data. The research questions 
were explored through: 1) focus group interviews; 2) a 
survey administered to a sample of students who experienced 
Academic Review Boards in Fiscal Year 2003; 3) a survey 
administered to a sample of staff who served as Academic 
Review Board members in Fiscal Year 2003; and 4) analysis 
of a school database that contains demographic and academic 
information on the ARB students. 


B. FOCUS GROUPS 


Thirteen active duty Sailors and five staff members 
assigned to Basic Hospital Corps School in Great Lakes, 


Illinois, were selected by availability for the focus group 








component of this study. Students who were selected had 
experienced three or more test failures and had appeared 
before an ARB in Fiscal Year 2003. Staff members who were 


selected had served as ARB members in Fiscal Year 2003. 


Before beginning each focus group interview session, 





the researchers introduced themselves and stated the 





purpose of the interview and the intent of the research. 


To ensure anonymity, the researchers stated that the 





collected data would be presented in terms of general 
themes and not individual statements. Researchers allotted 
time for brief introductions by participants in an effort 
to make all participants feel relaxed and at ease with the 
interviewing process. Researchers conducted interview 


21 





sessions in a private room. No staff members were present 
during the student focus group interviews, and no 


administrators were present during the staff focus group 








interviews. Focus group interviews were recorded on 
videotape. Students and staff members were interviewed 
separately. 








The interview questions were open-ended to allow 





interviewees the opportunity to elaborate and openly 


discuss concerns and experiences related to the academic 





review process. To facilitate more dialogue and openness, 
probing questions were used to help interviewees give 


further details about their experiences. An example of a 





question and probe: 


What are the Strengths and Weaknesses of the academic 


review process? 


e Does the academic review process foster 
interventions leading to enhanced student 
learning? (See Appendix A for a complete listing 
of the interview questions) 








The videotape was studied to identify recurring themes 





and concerns expressed by students and staff members. 


Insights gained from the interviews were used to develop a 





survey for distribution to a large sample of students and 
staff. 
(os SURVEYS 


A 48-question student survey (Appendix B) and a 30- 





question staff survey (Appendix C) were developed to 
measure the factors of the academic review process that 
have contributed to either IST success or IST attrition. 
The survey was also designed to gain better insight into 


student and staff perceptions about the strengths and 
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weaknesses of the academic review process. The questions 
were based on information gathered from focus group 


interviews with students and staff members. 


Both questionnaires were divided into five categories: 





individual characteristics; military information; strengths 
and weaknesses of the ARP; factors that influence ARB 
recommendations; and how decisions are made. The 
Individual Characteristics section consisted of multiple 
choice and yes/no questions that provided data on student 


demographics and current school status. The remaining 





sections consisted of Likert-scaled responses, categorical 








responses, and open-ended questions to determine the 





perceived effectiveness and perceptions of the academic 
review process. The values for the scaled responses ranged 


from 1 (not at all useful), to 4 (very useful). 


There were approximately 1100 students enrolled in 
Corps School when the survey was administered. Two groups 
were randomly selected from among these students and 
administered the survey: 1) 99 students (9 percent of those 
enrolled) who had not been involved with the ARB process, 
and 2) 35 students who had been involved with the ARB 
process. The 35 students represent three percent of those 
enrolled, and ten percent of those students who have been 
through an ARB. In addition, 20 staff members (12 percent 
of the staff) who had been involved in the ARB process were 
randomly selected and administered the survey. The surveys 
were administered to students and staff in separate groups. 
The respondents received a briefing on the purpose of the 


study. 
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The survey was administered on site by the 


researchers. After completion, subjects returned the 





completed survey to the researchers. No time limit was 





placed on completing the survey; however, all respondents 





had to finish the survey before leaving the room. The 


researchers were available for any questions. 





The researchers entered the survey data into 





QuestionPro, a data intelligence collection, analysis, and 
report-—generation engine. The data were analyzed using 
statistical analysis features of QuestionPro and Microsoft 
Excel. 


D. SCHOOL DATABASE 


A database that includes information on students 
involved in the ARB process is maintained at the Naval 
Hospital Corps School and was analyzed as part of this 
study. This database contains eight fields of information 
on 323 students who had experienced an academic review 
board in Fiscal Year 2003. The database includes 
information on the students’ level of education, age, ASVAB 
scores, reading levels, number of tests failed, modules 
failed (e.g., test 2, 6, 10), recommendations of the 
academic review board (ARB) chain, and the final 
disposition of the students (e.g., disenrolled or 
graduated). The database was analyzed to gain better 
insight into the consensus or lack of consensus when 
recommending setback or disenrollent of a student. The 
Microsoft Access database was analyzed through queries and 


cross-tabulation. 
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IV. RESULTS AND DISCUSSION 


A. INTRODUCTION 


This chapter presents the results of surveys 
administered to three samples: (1) 99 (Non-ARB) students in 
varying weeks of training, with the majority in training 
week eleven or twelve; (2) 35 students who experienced 
three or more test failures, resulting in their appearance 
before an Academic Review Board, and (3) 20 staff members 
who served as ARB members. This study seeks to:(1) define 
the academic review process and determine how it works, (2) 


analyze which factors influence the recommendations of the 








academic review board members, (3) explore the degree of 
consensus among ARB members when determining setback or 
disenrollment of a student, and (4) develop a theoretical 


model to derive the economic costs and benefits of the ARP. 





B. DEMOGRAPHICS OF SURVEY PARTICIPANTS 


The demographics are presented by sample groups: (1) 
Non-ARB student sample, (2) ARB student sample, and (3) 
staff sample. 

1. ARB and Non-ARB Student Demographics 


The Hospital Corps “A” school trains approximately 
3,500 students a year; 1100 students were enrolled in A- 
school when the survey was administered. The 99 Non-ARB 
students who took the survey represent 9 percent of the 
enrolled students who had not been involved with the ARB 
process. The 35 ARB students who took the survey represent 
three percent of the enrolled students and ten percent of 


those students who had been through an ARB. 
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As shown in Table 3, the demographics (age, pay grade, 
and education level) for the ARB and Non-ARB groups are 
very similar. The majority of students are in the pay 


grades E2 and E3 (67 percent and 75 percent, respectively). 





The preponderance of students are 21 years old or younger 
(77 percent and 78 percent, respectively). All of the 
students are high school graduates, and some have 
additional education (43 percent and 39 percent, 
respectively). 


2. Staff Demographics 


The ARB membership includes a Chair, usually the DIVO, 
ESSO, ISSO or any other officer so designated by the CO. 
Two other members must have instructional experience and 
must be senior to the student being reviewed. Of the staff 
members surveyed, thirteen (68 percent) are instructors, 
three (16 percent) are executive staff (DIVO, DAD), and 
four (16 percent) are instructional team members. 

When asked about experience as ARB members, 17 staff 
members responded, of those four (24 percent) have 
participated in one to three ARBs, four (24 percent) have 
participated in four to six ARBs, and nine (52 percent) 
have participated in seven or more ARBs. Of the 17 staff 
members who responded, the Chiefs (53 percent), and First 
Class Petty Officer (29 percent) communities have the most 


experience as ARB members. 
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Table 3. Demographics at Naval Hospital Corps School, 
as of JAN 04, for Non-ARB and ARB Students. 
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Cc. THE ACADEMIC REVIEW PROCESS 


The academic review process encompasses, but is not 
limited to, the following: (1) interventions available to 


students experiencing academic or non-academic problems 





(e.g., night study and student tutors); (2) communication 
and feedback mechanisms available to students to voice 
concerns and problems (e.g., course/instructor evaluations, 
Captain’s Call, staff interactions, and peer-to-peer 
interactions); and (3) preparation resources (e.g., in- 
class test guidance from instructors, and staff assistance 


outside of class time). 





Eighty-seven percent of the respondents of both 
student samples answered that the academic review process 
was first made known to them during orientation. Similarly, 
88 percent of the staff report that this is the procedure. 
The following section provides an analysis of the data 
concerning each element of the academic review process 
using the data gathered from both student groups (Non-ARB 
and ARB). 


1. Interventions 


Interventions primarily help students who are 
experiencing academic problems; they are also used as a 


preventive measure by those students who are not yet 





experiencing problems. The interventions available to 
students are night study, assistance from a student tutor, 
test-taking tips from instructors, and assistance from a 
staff member. The survey asked both student groups (1) how 
many test failures they had experienced; (2) what 


interventions they had received after the first or second 
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test failure; and (3) what counseling they had received 
after the first or second test failure. 


a. Test Failures 


As shown in Table 4, 65 percent of the Non-ARB 





students experienced no test failures, whereas 15 percent 


experienced two or more failures. In comparison, 94 percent 


of the ARB students experienced two or more test failures. 


No Failures Three >Three 
os gees Failures Failures 





Group 

10 Responses missing 

ARB Group (N=32) 3 3 12 13 
3 Responses missing 


Table 4. Percentage of Test Failures by Student 
Group. 





Note: Students who are experiencing academic problems can self-refer and 
request an appearance before the ARB. 





As shown in Table 5, 48 percent of all of the 





males experienced no test failures, whereas 52 percent 
experienced 1 or more failures. In comparison, 56 percent 


of all of the females experienced no test failures, whereas 








44 percent experienced 1 or more test failures. 


No Failures One Two Three >Three 
Failure | Failures Failures Failures 


Males (N=92) 


7 Responses missing 


Females (N=34) 
1 Responses missing 





Table 5. Percentage of Test Failures by Gender. 


b. Interventions Received after Test Failures 


Table 6 shows that, overall, night study and 
student tutoring were the two most frequently received 
interventions after experiencing a first or second test 


failure. Both groups report that help from a staff member 
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is the least frequently received intervention after a first 


or second test failure. 


After your first test failure, what intervention(s) did you receive? Select all 
that apply. 


Night Study Student Test-Taking Tips Help from Staff 
Tutoring 
ARB Group 
(N=35) 97 74 51 
poe Pow | we fw 


After your second test failure, what intervention(s) did you receive? Select 
all apply. 





Table 6. Percentage of Interventions Received after 
Test Failures. 


Note: Of the 99 Non-ARB students, only 20 percent reported having one test 
failure and 15 percent reported having two test failures. 





c. Counseling Topics Addressed after Test 
Failures 


Results presented in Table 7 show that after 
experiencing a first or second test failure, students from 
both groups were counseled most often concerning school 
preparation resources, study techniques, and test-taking 
tips. In addition, students in the ARB group were often 


counseled on their interest in being a hospital corpsman. 
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After your first or second test failure, 
hich of the following were you 
counseled in? Select all that apply. 


hy what you are learning is important to 51 
the Eating 


pe oe EP 
Your interest in being a Hospital Corpsman | 15[ 15] 2e| 80 
Stress management techniques | ii] 13] 14| 40 
Study techniques —SSSSCSC~—~S~S~sSC KE’ 
School_preparation resources ——S—S 2 


Table 7. Percentage Reporting Topics Addressed In 
Counseling After Test Failures. 








2. Comparison of Opinions: Interventions 





The students were asked to rate the usefulness of each 
intervention after experiencing a first or second test 
failure, using a four-point Likert scale: 


1-Not at all useful 
2-Somewhat useful 
3-Useful 

4-Very Useful 


Due to small sample sizes, the ratings were used to 


create two groups, those that rated the intervention as 





category 1 or 2 (not at all useful or somewhat useful) and 





those who rated the intervention as category 3 or 4 (useful 


or very useful). 


Table 8 shows that a majority of the ARB group found 
night study, student tutoring, and test-taking tips useful 
or very useful after the first and second test failure. 


Help from staff is not as useful as the other interventions 





to the ARB group. The percentages for the Non-ARB group 


after the first test failure are very close and show that 





23-32 percent rated the interventions as useful or very 
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useful. Note that the lower overall percentages for Non-ARB 





are because only a small percentage of the sample had 


experienced test failures. 





It is important to note that the percentages of 








respondents on Table 6 and the percentages on Table 8 are 
different (e.g., on Table 6, 51 and 49 percent of ARB 
students received help from a staff member, while Table 8 
shows that 66 and 63 percent said help from a staff member 
was useful). It is likely that this difference can be 
attributed to students having differing frames of reference 
related to staff helpfulness (i.e., staff members provide 
assistance to students during night study; and staff 
members also provide students with guidance for test 


preparation). 


Night Study Student 
Tutoring 





Table 8. Percentage Rating Intervention as Useful or 
Very Useful. 
Note: By inference, the percent in the other category (Not at all useful or 


somewhat useful) can be calculated by subtracting the percentages reported here 
from 100. 





32 


a. Strengths and Weaknesses 


To gain a better understanding of what is most 
helpful to students, ARB and Non-ARB survey respondents 


were given the opportunity to express their thoughts about 





the strengths and weaknesses of the interventions made 
available to them. This section summarizes qualitative data 


provided by the students. There were numerous comments 





provided, with two interventions receiving the most 


comments: student tutoring and night study. 


Fourteen of 40 (35 percent) students who 





responded to the open-ended question expressed satisfaction 
with the student tutoring program. Some examples of 
positive comments follow: 


With the assignment of a tutor I study a lot 
more. 


Tutors are always there to help you out. 


I had one chance left, my tutor explained 
everything to me, and I passed my test. 


Tutors provide ways to improve grades. 


Twenty-six of the 40 (65 percent) students who 





responded to the open-ended question expressed 


dissatisfaction with the student tutoring program. Most 





responses were from the perspective of the student being 
tutored; however, two of the responses out of the 26 


responses that were provided were from the perspective of a 





student tutor. Students are assigned as tutors based on 
their grade point average and their performance on written 
and practical tests. Student tutor comments follow: 


When someone needs ae tutor, they [the 
school] should use graduate hold students, 
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not students trying to learn their own 
material. It causes the tutor to fall 
behind. 


Make being a tutor voluntary. Some students 
learn better without feeling like they are 
taking their shipmates’ [tutor’s] time. 


The remaining 24 responses of those students who 





responded negatively to the open-ended question were from 





the perspective of the student being tutored. These 


comments illustrate a perceived dysfunction of the student 





tutor program: 


Tutoring by student, the fact is, a lot of 
times the tutors don’t even show up, but 
they put on the tutor sheet that they did. 


Some tutors help, but most feel that it isa 
waste of their [tutor’s] time. 


Student tutoring is a waste of time, I can’t 
learn that way. 


No one really feels comfortable studying 
with another student. 


Tutors know as much as me, so they really 
can’t 
help. 


My first test failure I was assigned a tutor 


and was lectured but nothing was really 
done. 


Thirty of 40 (75 percent) students who provided 





responses to the open-ended question expressed satisfaction 
with the night study program. The remaining 10 (25 percent) 
responses described features of the Learning Resource 


Center (LRC), the facility where the night study program is 





held. It could not be determined if those responses were 


meant to be positive responses or negative responses (i.ée., 
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“the LRC has ten computers,” or “the LRC closes at ten 
O’clock p.m.”). Some of the positive comments follow: 
In our particular night study everyone 


participates and makes it really fun. 


Night study provides class time and practice 
without pressure from instructors. 


Night study gives me an opportunity to learn 
practical labs. 


Night study helps me to get caught up. 
In night’ study, everyone has the same 


questions as me, so I am able to get my 
questions answered. 


b. Summary 


The data show that the interventions made 
available to students after experiencing a first or a 


second test failure are perceived by most students to be 





useful or very useful. Night study, student tutoring, and 
test-taking tips are the most frequently used 
interventions, and based on the qualitative comments of 
both groups, night study is useful. Though student tutoring 
is an intervention that many students use, and most think 


is useful, there is evidence from the qualitative comments 








from both students and tutors that there are potential 
problems in the program. The Non-ARB group’s numbers for 
second test failure interventions are more than 50 percent 
lower than the first test results, but directly attributed 
to fewer students in the group with two test failures. 


3. Feedback and Communication Mechanisms 


Feedback and communication mechanisms are in place to 


help students relay academic and non-academic concerns to 
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the chain of command. The primary feedback and 
communication mechanisms available to students are: (1) the 
informal communication system, and (2) the school’s open- 


door policy. 


The survey asked both student groups (1) what feedback 
and communication mechanisms are available to them to relay 
their concerns to their chain of command; and (2) which 
staff members have made an open-door policy known to them. 


a. Informal Feedback and Communication 
Mechanisms 


Table 9 shows that, overall, class discussions 


with the instructional team and peer-to-peer interactions 





were perceived as the two most frequently reported 
mechanisms available; next, almost one-half of the ARB 
group responded that surveys, course/instructor 
evaluations, and informal feedback through instructors were 
available to them to relay academic or non-academic 
concerns to the chain of command. Finally, both groups 
responded that Captain’s Call was the least frequently 
available mechanism to relay academic or non-academic 


concerns to the chain of command. 


36 


and communication mechanisms are 
available to you to relay your concerns 
to your chain of command concerning 
academic or non-academic issues? Select 
all that apply. 

Class discussions with instructional team 


Peer-to-peer interactions 


Surveys 
Course/instructor evaluations 
Informal feedback through instructors 


Informal feedback through instructional team 
Informal feedback through DIVO 
Captain’s Call 








None 
Table 9. Percentage Reporting Informal Feedback and 
Communication Mechanisms Available to 
Students. 
b. Open-Door Policy 


Results in Table 10 show that when asked who had 
explicitly informed students of their open door policy, 
both student groups (Non-ARB and ARB) responded the 
instructional team, the instructors, and the chaplain had 


made these policies known. It is noteworthy that a small 





percentage of students report that they were made aware of 
open-door policies from the Executive staff (i.e., SEL, 
DIVO, DAD, and the XO/CO). Conversely, 18 of 20 (90 
percent) staff members (three of whom were executive staff) 
responded that the school has an open-door policy; only two 
(10 percent) staff members responded that the school does 


not have an open-door policy. 


For the most part, both student groups are not 
routinely informed of open-door policies by the Executive 
staff; however, more of the ARB student group as compared 


to the Non-ARB student group received counseling on these 


ow 





policies from the Executive staff. The higher percentages 
among the ARB student group can possibly be attributed to 


their appearance before the Academic Review Board. 





Which of the following staff members 
have made an open-door policy known to 
you? 


Instructional Team 


Instructors 
Chaplain 





Senior Enlisted Leader (SI! 





Director of Academics (DAD) 


Deputy Director of Academics 
Department Head 





ee ee 
es ee ee ee 
Division Officer (DIVO) 
a a ae ee 
a a ee 
= ae ee 





XO/CO 
Table 10. Percentage Reporting Who Made Them Aware of 
an Open-Door Policy. 
4. Comparison of Opinions: Feedback and 
Communication 


Both student groups and staff members were asked to 





rate the usefulness of each informal feedback and 





communication mechanism, using a four-point Likert scale: 


1-Not at all useful 
2-Somewhat useful 
3-Useful 

4-Very Useful 


Due to small sample sizes the ratings were used to 





create two groups, those who rated the mechanism as 
category 1 or 2 (not at all useful or somewhat useful) and 


those who rated the intervention as category 3 or 4 (useful 





or very useful).check alignment all the way through 


Table 11 shows that a majority of both student groups 
found class discussions with instructional team members, 
peer-to-peer interactions, and survey critiques to be 
useful or very useful mechanisms. Informal feedback through 


instructors was useful for about half of the ARB group but 
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fewer of the Non-ARB group (29 percent). Informal feedback 
through instructional teams and DivO, as well as Captain’s 
Call, was perceived as least useful by both groups. 


Course/instructor evaluations and surveys were useful or 





very useful for approximately 60 percent of the ARB group 
but fewer of the Non-ARB group (36 percent and 42 percent, 


respectively). 





Staff members were asked how they would rate the 
feedback mechanisms available to students (to relay their 
concerns to their chain of command). As reported in Table 
11, staff members rated all of the feedback and 
communications mechanisms available to students as useful 
or very useful. 


On a scale of usefulness, rate the ARB Group | Staff 
feedback and communication mechanisms 

that you have used to relay your 

concerns to the chain of command (N=35) (N=20) 
concerning academic or non-academic 

issues. Select all that apply 


Class discussions with instructional team hE ae a ae 100 


Peer-to-peer interactions ee 


Informal feedback through instructional 23 37 
team members 


Surveys ae ee ee ee 
Captain’s Call 





Table 11. Percentage Rating Mechanism as Useful or 
Very Useful. 
Note: By inference, the percent in the other category (Not at all useful or 


somewhat useful) can be calculated by subtracting the percentages reported her 
from 100. 








To gain additional insight into student-staff 
interaction, the students were then asked to rate the 


helpfulness of staff members and students were asked to 





rate the degree of ease they felt in communicating with 


staff members, using a four-point Likert scale: 
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Staff Helpfulness Communicating with Staff 


1-Not at all helpful 1-Very Difficult 
2-Somewhat helpful 2-Somewhat Difficult 
3-Helpful 3-Easy 

4-Very Helpful 4-Very Easy 


Due to small sample sizes the above ratings were used 





to create two groups, e.g., those who rated staff 
helpfulness as category 1 or 2 (not at all helpful or 
somewhat helpful), and those who rated staff helpfulness as 
category 3 or 4 (helpful or very helpful). 


Table 12 shows that a majority of both student groups 
(Non-ARB and ARB) found the instructional team (70 percent 
and 89 percent, respectively) and the instructors (64 
percent and 69 percent, respectively) to be helpful or very 


helpful. About one-half of the ARB group reported the 





chaplain and SEL to be helpful or very helpful. 





The findings also show that a smaller percentage of 


both student groups reported the Executive staff (i.e., 





DAD, DIVO, SEL, and CO/XO) to be very helpful or helpful. 
The ARB student group, in comparison to the Non-ARB student 


group, found the Executive staff slightly more helpful. 
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On a scale of helpfulness, rate Non-ARB ARB 
the following staff members. Group Group 
(N=99) (N=35) 
Instructors 64 69 
Instructional team members 70 89 
Chaplain 30 46 
Division Officer 31 37 
Senior Enlisted Leader 32 49 
Director of Academics 24 40 
Deputy Director of Academics 21 34 
Department Head 22 29 
XO/CO 22 34 
Table 12. Percentage Rating Staff Members as Helpful 


or Very Helpful. 


Note: By inference, the percent in the other category (not at all helpful or 
somewhat helpful) can be calculated by subtracting the percentages reported 
here from 100. 








Table 13 shows that the trend is very different for 
ease of communication with these staff members. The Non- 
ARB group found all staff members to be easy or very easy 
to communicate with. The ARB group, in comparison to the 
Non-ARB student group, found all staff members to be easy 
or very easy to communicate with except the DAD, DH, and 
XO/CO. A substantial majority of the ARB group found the 
DAD, DH, and XO/CO somewhat or very difficult to 
communicate with, which is most likely attributed to not 
liking what they heard or being scared by those higher in 


the chain of command. 
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On a scale of ease of Non-ARB ARB 
communication, rate the Group Group 
following staff members. (N=99) (N=35) 
Instructors 82 89 
Instructional team members 83 86 
Chaplain 70 74 
Division Officer 68 66 
Senior Enlisted Leader 68 69 
Director of Academics 58 63 
Deputy Director of Academics 60 11 
Department Head 60 11 
XO/CO 62 14 
Table 13. Percentage Rating Staff Members By Means of 


Ease of Communication w/ or w/o a period 





Note: By inference, the percent in the other category (very difficult or 
somewhat difficult) can be calculated by subtracting the percentages reported 
here from 100. 





a. Strengths and Weaknesses 


The survey did not ask a specific question 
related to the strengths and weaknesses of the feedback and 
communication mechanisms available to students; however, a 


section of the survey asked respondents to provide feedback 





on what was most helpful. There were numerous comments 


provided; however, one theme emerged that focuses on 





positive staff and student interactions. This section 


summarizes comments provided by the students. 


Strength in feedback and communication exists in 
the interactions between students and staff members at the 
instructor and instructional team level (i.e., HMC, HM1, 
and HM2). Eighty-seven students commented on the 
interactions they have with, and the guidance and reviews 
they received from, the staff. Twenty-four of these 
students commented that they found the interactions with 
instructors and the instructional team to be helpful or 


very helpful. Some of the positive comments follow: 
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Instructors want you to do better. 


I feel like my instructor understands why I am failing 
and tries to help me. 


After my first test failure I talked to an Instructor. 
He told me that I could do it. 


The staff tries to figure out if you have a 
disability. They pay attention and try to help you. 


Instructors try to help you make it, even when you 
want to give up. 


b. Summary 


A weakness in feedback and communication is 
represented by the contradiction between student and staff 
perceptions of the utility of the feedback and 


communication mechanisms that are available to students. 





The staff responses clearly indicate that they perceive all 
mechanisms to be useful or very useful to the students, 
while student perceptions of utility are substantially 


lower for both ARB and Non-ARB groups. The perceived 





differences evidenced by both groups (students and staff) 
can potentially serve as a barrier to creating a feedback 
and communication system that meets the needs of the 
students. In addition, another potential barrier to an 


effective feedback and communication system is the lack of 





ease the ARB group experienced in communicating with some 
Executive staff members. 


5. Resources 


Resources are available to help students succeed 


academically. The resources include test preparation 
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provided by instructors, and staff assistance outside of 


class hours. 





To gain insight into whether the resources are meeting 
the needs of students, the survey asked both student groups 
(1) if guidance is provided for test preparation and (2) if 
there is consistency between what instructors teach and 


what students are expected to know for a test. 


As shown in Table 14, a high percentage of respondents 
in both groups answered that they were provided guidance 


for test preparation, and that there is consistency between 





what instructors teach and what they are expected to know 


for a test. 









































Is guidance provided Non-ARB ARB Group 
for test preparation? Group (N=99) (N=35) 
Yes 85 86 
No 2 3 
Responses missing 13 11 
Is there consistency between what Non-ARB ARB Group 
instructors teach and what you are expected Group 
to know for a test? (N=99) (N=35) 
Yes 13 83 
No 20 17 
Responses missing 7 0 
Table 14. Percentage Reporting Guidance Provided for 

Test Preparation and Consistency of 

Instruction. 

a. Comparison of Opinions 


To get a better estimate of whether the available 
resources are meeting the needs of the students, the 
students were asked to rate each resource, using a four- 


point Likert scale: 
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Guidance for Test Assistance Outside 


Preparation of School Hours 

1-Not at all useful 1-Not at all satisfied 
2-Somewhat useful 2-Somewhat satisfied 
3-Useful 3-Satisfied 

4-Very Useful 4-Very satisfied 


Due to small sample sizes the above ratings were 





used to create two groups, those who rated guidance 
provided for test preparation as category 1 or 2 (not at 
all useful or somewhat useful), and those who rated 
guidance provided for test preparation as category 3 or 4 
(useful or very useful). The satisfaction data were 


similarly grouped. 


Table 15 shows that over 90 percent of both 
student groups found that guidance provided for test 


preparation by staff members is useful or very useful. 





Table 16 shows that an equal or higher percentage of Non- 


ARB and ARB students experience satisfaction in their 





ability to receive staff assistance outside of class hours. 























On a scale of usefulness, rate the Non-ARB ARB 

guidance provided for test preparation Group (N=99) Group (N=35) 
93 94 

Missing responses 7 6 

Table 15. Percentage Rating Test Preparation as Useful 


or Very Useful 





Note: By inference, the percent in the other category (not at all useful or 
somewhat useful) can be calculated by subtracting the percentages reported here 
from 100. 




















On a scale of satisfaction, rate your Non-ARB Group | ARB Group 
ability to receive assistance outside of (N=99) (N=35) 
class hour. 

94 100 
Missing responses 6 0 
Table 16. Percentage Rating Assistance Outside of 


Class Hours as Satisfied or Very Satisfied 


Note: By inference, the percent in the other category (not at all satisfied or 
somewhat satisfied) can be calculated by subtracting the percentages reported 
here from 100. 
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When asked about their ability to provide 
assistance outside of class hours, 19 staff members 
responded; one staff member did not provide a response. Of 
the staff members who provided a response, fifteen (78 
percent) responded that sufficient time was available to 
provide assistance outside of class hours, and four (22 
percent) members responded that sufficient time was not 


available to provide assistance outside of class hours. 


Of the four staff members who responded 
sufficient time was not available to provide assistance 
outside of class hours, only one comment of explanation was 
provided. The staff member stated that there was not enough 
staff to handle the job, and that the majority of staff 
time was spent dealing with administrative issues. 


b. Strengths and Weaknesses 


To gain a better understanding of what is helpful 





to students, survey respondents were given the opportunity 
to express their thoughts about the strengths and 


weaknesses related to the guidance provided to students for 





test preparation. The survey did not ask respondents an 





open-ended question concerning the availability of 


assistance from staff members outside of class hours. 


Twenty-one of 35 students (60 percent) who 





responded expressed satisfaction with the guidance provided 


for test preparation. Some of the positive comments follow: 


It (test preparation) gives me techniques and 
tips on how I am going to take a test. 


It (test preparation) helps to teach me the 
material that I need to know. 


46 


HMC would go out of his way to prepare us for a 
test. I would not have passed without his help. 


It (test preparation) provides many ways to get 
the information that I missed. 


Test preparation helps by serving as a review 
session. It enables us to go over material that 
we may have found particularly hard. 


It (test preparation) is good because it is 
another way of putting the information in your 
head. 


During test preparation we go over everything 
that we need to know for the test; but not too 
quickly, like in class. 


Approximately 14 comments (40 percent) could be 
interpreted as negative or mixed. The comments seemed to 
express concern with instructor approaches to facilitating 
review sessions, and concern with the commitment of 
instructors to student success. Some illustratives follow: 


Instructors provide too much information in very 
little time. 


Instructors sometimes give vague explanations on 
confusing material. They [instructors] try and 
rush through the material because they are ready 
to go home. 





It really depends on the instructor providing the 
review. Some will actually try to teach the 
lesson. Others will just click the mouse and keep 
going without really trying to explain during the 
review. 


Depending on the instructors, test review can be 
useful if the instructor actually teaches instead 
of talking about experiences. 
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Depends on the instructor doing the review. I’ve 
only met two out of ten that really care about 
the Sailor, more than they care for themselves. 


c. Summary 


Overall, the findings show both student groups 
are satisfied with the resources that are available to 
them. In addition, the majority of staff members and the 
majority of both student groups are satisfied with the 
assistance outside of class hours. While the ratings were 
very positive, some of the qualitative comments highlight 
areas for possible improvements. 


D. THE ACADEMIC REVIEW BOARD 


The results reported in this section are based on the 
responses of 35 students who had experienced three or more 
test failures, resulting in their appearance before an 


academic review board; and 20 staff who had served as ARB 





members in FY03. The objective of this section is to 
explore the ARB process through the perceptions of board 
members and students who had experiences with the ARB. 


1. The Decision Process 


To gain a better understanding of the factors that may 
influence the ARB in their decisions, the survey asked 
respondents: 


1. Does the ARB have the right/complete information 
necessary for making decisions? 

2. Which factors are weighed most heavily by the ARB 
members when making a decision? 

3. Which recommendation does the ARB weigh most heavily 
when making their decision? 


a. Factors that Influence Decisions 





There are numerous factors that have the 


potential to influence recommendations of retest/retain, 
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setback, or disenrollment, such as, (1) number of test 
failures, (2) student practical performance, (3) student 


motivation, and (4) attrition and retention policies. 


When asked if the ARB has the right/complete 





information necessary to make retest/retain, setback or 
disenrollment decisions, 19 of 20 staff members (90 
percent) responded affirmatively. Conversely, 14 of 35 ARB 
students (57 percent) responded that the ARB does not have 


the necessary information. Student comments detailing this 





issue are presented in the discussion of qualitative data 
later in the chapter (Section C below). However, nothing 
in the qualitative data presented elaborates specifically 
what information the students think is missing. Further 
clarification about this is not available and may merit 


additional inquiry. 


For a more accurate assessment of which factors 
ARB members and students think are important in the 
decision making process, both groups were asked to rate 


factors in terms of how much weight each factor is given by 





the ARB in determining whether to recommend setback or 
disenrollment of a student, using a four-point Likert 
scale: 


1-Not at all considered 
2-Somewhat considered 
3-Considered 

4-Very Important to the decision 





Due to small sample sizes the above ratings were 
used to create two groups, those who rated factors 
considered by the ARB as category 1 or 2 (not at all 


considered or somewhat considered), and those who rated 
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factors considered by the ARB as category 3 or 4 


(considered or very important to the decision). 





As shown in Table 17, all the percentages are 
high, and differences may not be meaningful due to the 
small numbers of respondents. Board member and student 
responses show that all the factors included in the survey 
are perceived to be given significant consideration when 
making a determination to retest/retain, setback or 


disenroll a student. 





Rate each factor in terms of how much you Staff ARB Student 
think each is considered by the ARB in the Group 
decision to retest/retain, setback, or (N=20) (N=35) 


disenrollment of a student 









































Student Motivation 100 100 
Information provided by team leader 100 94 
Documentation of Night Study 100 94 
Class participation 95 91 
Information provided by tutor 100 91 
Ability to produce class notes 100 86 
Test Scores 95 89 
Number of tests failed 100 91 
Practical Performance 85 cal 
Table 17. Percentage Rating Factors as Considered or 


Very Important to the Decision. 


Note: By inference, the percent in the other category (not at all considered or 
somewhat considered) can be calculated by subtracting the percentages reported here from 
100. 


The survey asked board members the following 
questions: (1) Whose recommendation does the board weigh 
more heavily? (2) Whose recommendation does the CO weigh 
more heavily? (3) Does retention or attrition influence 


recommendation to setback or disenroll? 





Twenty-five percent of board members did not 
answer the first two questions in Table 18. Table 18 shows 
that when making a determination to retest/retain, to 


setback, or to disenroll a student, 40 percent of the ARB 
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members weigh the recommendation of the instructor more 





heavily than the others. 


the Commanding Officer’s decision-— 


making process. Thirt 


five percent of the ARB members responded that the 


Commanding Officer gives the most 


recommendation of the ARB; however, 


weight to the 


30 percent felt more 


weight was given to the recommendations of the Executive 


Officer. 
Director of Academics was weighed 
percentage differences may not be 


small numbers of respondents. In 


Only 10 percent felt the recommendation of the 


most heavily. The 
meaningful due to the 


response to whether 





attrition and retention influence 


their recommendation, 


members responded 80 percent to 15 percent that these 


factors have no influence on their decision. 


The members were also asked about 


y- 


ARB 
























































Whose recommendation does the Frequency 
board weigh more heavily? (N=20) 
Team Leaders 20 
Instructors 40 
Division Officer Ams) 
Responses missing 25 
Whose recommendation does the CO 

weigh more heavily? 

ARB 35 
DAD 10 
XO 30 
Responses missing 25 
Do attrition and retention influence 

your recommendation? 

Yes 15 
No 80 
Response missing 3 
Table 18. Percentage of Board Members Reporting 


Factors that Influence Recommendations. 
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b. Comparison of Opinions 


To gain better insight into student and staff 





perceptions of board representation, the effectiveness of 


the rebuttal process, and the overall fairness of the ARB, 





students and staff members were asked (1) if they see the 
ARB decision process as fair; (2) if students were told of 
their option to submit a rebuttal; and (3) if team leaders 


and class leaders should accompany students to the ARB. 


Nineteen of 35 students (54 percent) and 18 of 20 





ARB members (90 percent) expressed a belief that the ARB 
decision process is fair. Student comments detailing how 
the perceived fairness or unfairness of the ARB affects 
their motivation are presented in the discussion of 
qualitative data later in the chapter (Section C below), 
however nothing in the qualitative data presented 
elaborates specifically how the ARB decision process is 
seen as unfair. Further clarification about this is not 
available and might merit some follow-up inquiry. A follow-— 


up question was asked of the ARB members about how students 





perceive the ARB. Respondents were asked to answer based 
on a usefulness scale, with 1 indicating not at all useful, 


2 indicating somewhat useful, 3 indicating useful, and 4 





indicating very useful. Eighty-five percent (17 of 20 ARB 





members) of the respondents expressed a belief that the 
students see the ARB process as somewhat useful or not at 


all useful. 


A follow-up question was also presented to the 





students. They were asked to select as many responses as 
applicable (shown below) regarding their ARB experiences. 


As shown in Table 19, almost all report their ARB 
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experience as having both positive and negative aspects. 





For example, 100 percent describe the experience as 
providing positive reinforcement as well as a negative 


environment (harsh, critical, likely to fail). The data 





show that regardless of the experience, assistance was 


ultimately offered. 
































Indicate which of the following you have experienced ARB 
regarding an ARB. Select all that apply Student 
Group 
(N=20) 
Positive reinforcement (conveyed faith in you) 100 
Threats/intimidation 85 
Positive environment (encouraging) 90 
Negative environment (harsh, critical, likely to fail) 100 
Offer of assistance 100 
ARB refused assistance 40 
Table 19. Percentage Reporting ARB Experiences. 


The ARB students and staff were asked about the 
student rebuttal option and the ARB membership. The 


questions asked if students were informed of their option 





to submit a rebuttal, if they used the option, and if it 
was useful. They were also asked if they thought class 
advisors and team leaders should accompany students to the 
board or sit on the board as a representative. As shown in 
Table 20, 100 percent of ARB members responded that 
students were made aware of their option to submit a 
rebuttal. However, only 46 percent of the students 
responded that they were told of the option. Of those who 
knew of the option, 88 percent used it and 75 percent 


expressed that it was useful. 


Also shown in Table 20, ARB members and students 


were not in agreement regarding the ARB composition. About 
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half the students and staff support Class Advisors 
accompanying students to the ARB. Students responded 
similarly to Team Leaders accompanying students to the 
board; however, only 15 percent of the staff supports Team 
Leaders accompanying students. ARB students overwhelmingly 
support having Class Advisors or Team Leaders as ARB 
representatives (100 and 94 percent, respectively). The 
staff is against this (70 and 95 percent, respectively), 


probably in consideration of time constraints for classroom 
















































































instruction. 
Are students told of their option to submit a Staff ARB 
rebuttal? Students 
(N=20) (N=35) 
Yes 100 46 
No 0 54 
Responses missing 0 0 
Did you use the rebuttal option? (N=16) 
Yes 88 
No 12 
Was the rebuttal option Useful? (N=16) 
Yes 75 
No 13 
Responses missing 12 
Do you feel Class Advisors should accompany 
students to the board? (N=20) (N=35) 
Yes 45 49 
No 50 51 
Responses missing 5 0 
Do you feel Team Leaders should accompany 
student to the board? (N=20) (N=35) 
Yes 15 46 
No 70 46 
Responses missing 15 8 
Do you feel Class Advisors should be a 
representative on the board? (N=20) (N=35) 
Yes 25 100 
No 70 0 
Responses missing 5 0 
Do you feel Team Leaders should be a 
representative on the board? (N=20) (N=35) 
Yes 5 94 
No 95 6 
Responses missing 0 0 
Table 20. Percentage Reporting on Student Rebuttal 


Option and Student ARB Representation. 
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c. Strengths and Weaknesses 


To better understand what is really helping 


students, respondents were given the opportunity to express 





their thoughts about the strengths and weaknesses of the 


Academic Review Board. 


Students were asked if the ARB had the correct or 
complete information to make decisions about setback or 


disenrollment recommendations. Of the 35 responses to this 





question, four (11 percent) were positive and 31 (89 
percent) were negative responses. Some positive comments 


follow: 


Nothing is wrong with the ARB. 


Nothing, it is good the way it is. 


The ARB is accurate enough; I would not change a 
thing. 


Start ARB process at the first test failure. The 
knowledge you receive is great. 


There were 31 negative comments. The following 


selections represent the majority of these opinions: 


It would be more regulated by point criteria. It 
would eliminate the unfairness that students feel 
towards it [ARB]. 


The counselor or chaplain should be there as 
well, because they make you feel worthless. 
Having a chaplain there might control some of 
that. 





They should talk to you more like a person. No 
one should be talked to the way that I was that 
day. 
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I would try to lessen the negative impact of it 
[ARB]. First the waiting at parade rest made me 
feel like I was in trouble-was going to _ get 
yelled at or belittled. The one who failed you 
should not be on the board. 


Just be fair all around, not just sometimes. 


ARB students were asked to explain why they felt 
the rebuttal option was or was not useful. Of 34 responses 


(one ARB student did not provide comments), 19 students (54 





percent) expressed that the rebuttal option was not useful 
because they did not know about it. Of the 14 students who 
used the option, 12 (86 percent) provided positive 
comments. The remaining two students (14 percent) did not 


provide comments. 


Below are positive comments that best represent 





the majority of comments:line spacing - 1.5” 


It was useful. I was kept here [in school]. 





The CO was the only one to help me after the ARB. 


It was useful. It gave me a chance to prove 
myself. 


It [rebuttal option] brought me where I am today. 


The CO heard my side of the story. 


Yes it is useful. I am still in school. 


I was able to tell the CO exactly why he should 
let me stay. It helped me pinpoint the reasons, 
motivating factors for being in the Navy. 


Yes it was useful. I’m still here. 


56 


It helps to show how much you really want to be 
here and why you think you should be here. It is 
your last chance to make your case 


Students were asked how the perceived fairness or 
unfairness of the ARB affects their motivation. There were 
35 responses to this question, four (11 percent) positive 
responses and 31 (89 percent) negative responses. Positive 
comments follow: 


It makes you strive to do better to achieve your 
goals. 


It makes me more motivated to achieve my goals. 


The fairness affects my motivation by making me 
strive to work harder 


It makes you want to prove to others that you can 
do it. 


Below are examples of comments that best 


represent the majority of the negative comments: 


They make false decisions without knowing 
anything about you or your type of background. 


I felt pushed around by the rank and 
uncomfortable with them [ARB]. I have only found 
motivation to further proceed in school by being 
told, “The fleet is for me.” Tell me that I can’t 
do something. 





No one learns the same way. The ARB bases your 
outcome with the same rules and regulations as 
everyone else, and it makes you feel like a 
number, not a student. 





Before the student comes before the board, they 
already have their answer. 
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After the ARB they scared me to the point where I 
would vomit and lose sleep. The approach they 
took was way too hostile. 


I felt as if my voice was not heard. My thought 
at the end was that I believed the decision was 
made before I walked in the door. I wasted my 
breath. 





It affects my motivation a lot. My friend got 
disenrolled [be]cause his advisors didn’t like 
him. He was a good person and would have made a 
great HM. I failed the same amount of tests and I 
got to stay. I don’t think the ARB is fair to 
all people. 





Fairness is setting you back and giving you 
another chance. Unfairness is getting to test 
number 14 and not getting a second chance. 


d. Summary 


The results indicate agreement amongst the ARB 
members and students concerning what factors are considered 
in the ARB decision process. However, the rebuttal system 


is a major concern. Of the 35 students who appeared before 





the ARB, over 50 percent indicated that they had no 
knowledge of their option to submit a rebuttal. Of those 
who knew of the option, 86 percent found it helpful. This 
helpfulness is further illustrated in the student comments. 
The 50 percent who did not know of their option to submit a 
rebuttal may have benefited from a better understanding of 
their rights. The next section will address the ARB cases 
for FY 03. 


2. Disposition of ARB Cases FY 03 


In Fiscal Year 2003, 2,169 students accessed into 
Corps school. Of those, 324 students (15 percent) appeared 


before the ARB as a result of three or more test failures. 
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This section analyzes the recommended action for final 
disposition of those 324 students. The ultimate decision 


is made by the CO, who receives recommendations from the 





instructional team, DIVO, ARB, DAD, and the XO. The 





objectives of this section are to analyze the degree of 


consensus between the recommendations of setback or 





disenrollment and the CO’s final disposition, as well as 
attempt to determine which level in the decision-making 
process is most accurate at predicting student success. 


a. Demographics 


Of the 324 students appearing before the ARB, 230 
(71 percent) were males and 94(29 percent) were females. As 
shown in Table 21, the ASVAB scores for the majority of 
students ranged from 119 to 190, which are all AFQT 
Category I-IIIA or below. Sixty-one (19 percent) of these 
students were previously enrolled in PLATO, a computer-— 
based and e-learning instruction for adult learners 
offering curricula in reading, writing, math, science, 
social studies, and life and job skills. Of the 61 students 
who were enrolled in PLATO, 14 (23 percent) successfully 
completed Corps school; however, the remaining 47 (77 


percent) students were subsequently disenrolled. 


Of the students who appeared before the ARB, 116 





students (36 percent) successfully completed Corps school; 
171 students (53 percent) were subsequently disenrolled. At 
the time of this study, 37 students (11 percent) were in 
week 9 of their training and their final disposition is 


unknown. 
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ASVAB RANGES 

119- 140- 150- 160- 170- 180- 190 

139 149 159 169 179 189 
Number of ARB 17 26 52 17 3 1 0 
students that 
graduated by ASVAB 
Range 
N=116 
Number of ARB 
Students in ASVAB 43 80 136 47 14 3 1 
Range 
N=324 
PLATO 14 (23 percent) Graduated 
N=61 ASVAB Range: 132-155 

47(77 percent) Disenrolled 

ASVAB Range: 124-166 
Table 21. Fiscal Year 2003: ARB Education 

Demographics. 
b. The Academic Review Board: The Decision 
Process 


The first step in the decision process begins 
with the recommendation of the student’s chain of command, 
which are forwarded to the ARB. The student’s instructional 
team makes a recommendation to the CO via the ARB, Director 
of Academics, and the Executive Officer. The ARB interviews 
the student and makes a recommendation to the Commanding 
Officer via the DAD and XO. After reviewing all of the 
recommendations, the Commanding Officer makes the final 
determination. The next sections look at the degree of 
consensus between some the chain of command and the CO 
recommendations regarding setback and disenrollment. 


c. Consensus of Recommendations: Setback 


Table 22 illustrates the high degree of consensus 





between the recommendations of setback and the CO’s final 


determination. For example, at the Team level 211 students 
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the 





received recommendations of setback; of those, 


Commanding Officer concurred with the recommendations of 


the Team 201 times, resulting in a 95 percent consensus. 


Because of this high consensus, the completion percentages 


of setback students are almost the same for the team and 


the CO, as shown in the table. Overall, slightly more than 


50 percent of setback students were ultimately graduated. 


It is important to increase the percentage of students that 





complete training; this will be addressed later in the cost 


analysis section of this chapter. 






































between the recommendations of disenrollment 





final determination. 
recommendations of disenrollment is lower, 


setback recommendations. 





The degree of consensus 


For example, as 


in 


CO’s Decision | Percentage of Team Co’s 
Consensus Completion Completion 
Team Percentage Percentage 
(N=211) (N=201/211) (N=107/211) (N=107/201) 
Setback (201) 
Retain (0) 95 51 53 
Disenroll1 (10) 
CO’s Decision | Percent of ARB Completion | CO’s 
Consensus Percentage Completion 
ARB Percentage 
(N=189) (N=182/189) (N=101/189) (N=101/182) 
Setback (182) 
Retain (1) 96 53 56 
Disenroll (6) 
CO’s Decision | Percentage of DAD Completion | CO’s 
Consensus Percentage Completion 
DAD Percentage 
(N=223) (N=208/223) (N=111/223) (N=111/208) 
Setback (208) 
Retain (0) 93 50 53 
Disenroll1(15) 
Table 22. Recommendation Consensus: Setback. 
d. Consensus of Recommendations: Disenrollment 
Table 23 illustrates the degree of consensus 


and the CO’s 


as compared to 


shown in Table 23, 


at the ARB level 133 students received a recommendation of 


disenrollment; 


of those, 


the Commanding Officer concurred 
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with their recommendations of disenrollment 88 times, 


resulting in a 66 percent consensus. 





Table 23 also illustrates the degree of error in 
the recommendation process, as evidenced by the following: 
(1) 13 of 45, 7 of 26, and 3 of 19 students received 
recommendations of disenrollment (at the ARB, Team, and DAD 
levels, respectively) and ultimately graduated. The 
students from each of these subsections may not be 
different; they may all be subsets of the ARB 13 that 
graduated. The CO did not concur with the disenrollment 
recommendations; the students were given a second chance. 


Likewise, (2) there are 32 of 45, 19 of 26, and 16 of 19 





students that received recommendations of disenrollment 
(from the ARB, Team, and DAD, respectively) but the CO did 
not agree and ultimately setback these students. Some of 
these students may be the same for each group; they were 


setback but did not successfully complete Corps school. 


Examining the data provided in Table 23, it 
appears that the Director of Academics was the most 
accurate at predicting potential training failures. Of the 
98 students recommended for disenrollment by DAD, only 


three students subsequently completed the training program. 


In order to reach a fair assessment as to which 
level in the decision-making process is most accurate at 
predicting student success, it would be necessary to know 
what decision factors or criteria were used to help reach 


the decision by each recommending group/individual. 


Assuming that the objective is to provide every 





qualified Sailor the opportunity to reach their full 


potential by providing a second chance, the results 
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regarding setback recommendations show that there is a high 
level of consensus towards this objective amongst the 


decision makers. 





However, assuming the objective is to identify Sailors 


early in the training program deemed as not having the 


potential to be a quality HM, the results show that the ARB 






































has the highest disenrollment recommendation rate (133), 
followed by the Team level with 110 disenrollment 
recommendations. 
Team CO’s Decision | Percentage Completion CO’s 
(N=110) of Percentage of those | completion 
Consensus who would have been | Percentage 
disenrolled by ARB 
(N=84/110) (N=7/110) (N=7/26) 
Setback (26) 
Retain (0) 76 6 27 
Disenroll (84) 
ARB CO’s Decision | Percentage Completion CO’s 
(N=133) of Percentage of those | completion 
Consensus who would have been | Percentage 
disenrolled by Team 
(N=88/133) (N=13/133) (N=13/45) 
Setback (45) 
Retain (0) 66 10 29 
Disenroll (88) 
DAD CO’s Decision | Percentage Completion CO’s 
(N=98) of Percentage of those | completion 
Consensus who would have been | Percentage 
disenrolled by DAD 
(N=79/98) (N=3/98) (N=3/19) 
Setback (19)) 
Retain (0) 81 3 16 
Disenroll (79) 
Table 23. Recommendation Consensus: Disenrollment. 
e. Strengths and Weaknesses 
To gain a better understanding of the decision 
process, staff was given the opportunity to express their 
thoughts about the strengths and weaknesses of the ARB 
process. They were asked, if one component of the process 
could be improved, what would it be and why. Seven of 20 
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(35 percent) staff members responded to the open-ended 


question. The comments follow: 


The implementation of standardized questions so 
the process is more consistent 


Look at the entire Sailor, not just at his/her 
academics. 


Have students appear in person at all tlevels 
after the ARB, (i.e., student will see SEL, DAD, 
XO, & CO). They will get the opportunity to see 
what the board sees. 


ARB could be better utilized earlier on maybe 
after the, 2° test.-failure;. Have. woper COC - talk 
with member, show concern, and give guidance 
before sent to board to make a decision. 


Time—ARB packages take too long to go through 


chain of command. Too many hands in the pot. 
Sometimes it [ARB packages] sits on a desk for 24 
hours. 


Forget numbers and give those students who have 
demonstrated their desire to become a Corpsman a 
fair chance. There are students here who have 
demonstrated no/little desire to becoming a HM 
and they get a second chance just to fail a 
fourth test. 





Not let attrition rates dictate how many 
[students] stay or go. 


Two follow-up questions were asked concerning the 
strengths and weaknesses of the decision making process. 


Staff members were asked: whose decision does the CO weigh 





more heavily and why, and how does this affect your 


motivation to be a board member? Eleven of 20 (55 percent) 





staff members responded to the open-ended question. There 
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was a mixture of responses, negative (46 percent), positive 
(27 percent) and neutral (27 percent). Some negative 
comments follow: 

Not sure, because a lot of packages have had 


disenroll on them up to that level, once there 
[Headquarters] the recommendation changes. 








The Navy [influences recommendations] because 
they are pushing the numbers. 


None [factors CO weighs]. The recommendation is 
futile; the COC will give the student another 
chance to perform poorly. 


CO accepting recommendations at face value and 
disenrolling poor performers instead of giving 
them more chances. 


I think that the CO should not think of retention 
and money when making his decision. We are 
training personnel to take care of human lives. 
I think that we need more quality and not 
quantity. This is not a factory line. 


Positive comments follow: 


None [factors CO weighs] he looks at all the 
material and input and makes all decisions based 
on what is best for the Navy and the student. 


I feel the CO knows the process. 


I think the process is good. In my opinion, the 
recommendation of the board should weigh more 
heavily than that of the DAD or XO because they 
do a lot of face-to-face interviews of the 
student, see the student’s material and can make 
the best decision. I realize that the DAD or XO 
do not have the time to sit on these boards and 
the intimidation factor for the student to great 
for them to do a face-to-face. 
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f. Summary 


There appear to be competing objectives in the 





decision-making process. It seems the objective of the ARB 
is to identify Sailors early in the program deemed as not 


having the potential to be a successful HM, as evidenced by 





the high number of disenrollment recommendations (133) and 
qualitative comments provided by staff members. Conversely, 


it seems that the objective of the CO is to provide 





students every opportunity to successfully complete the 
training, as evidenced by the high number of non-concur of 


disenrollment recommendations (90), and the subsequent 





setback of students. Based on qualitative comments, it 
would appear staff members do not understand the 
determination process of the Commanding Officer, and 
apparently staff members are not provided feedback 


concerning the decisions that are made. 


Staff comments provide evidence that standardized 
procedures and questions would be beneficial to the 


effectiveness of the process and helpful in promoting a 





perception of fairness among the students and staff. In 
addition, the ARP would be improved by implementation of 
the ARB prior to the third test failure. 

E. COST ANALYSIS FRAMEWORK 


A secondary objective of this thesis is to determine 


the economic costs and benefits of the ARP. Two questions 








must be answered to determine the cost-effectiveness of 


this process. First, the cost of operating the process 








must be determined. The second question must determine the 
costs of the effects of the process. This is answered by 


computing the costs of setbacks and disenrollments. The 
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necessary data to perform the calculations were unavailable 


at the time of this study, therefore, the following 





framework is provided as guidance for future researchers. 





The last cost that will be examined is how errors based on 
the CO’s decision increases the cost of student throughput. 


1. The Real Versus the Ideal 


In an ideal world, every student would complete 
Hospital Corps School in the minimum allotted time (course 
length). No student would be setback or disenrolled. 

Thus, in the ideal, the number of students required by the 
fleet would equal the number of students initially enrolled 


in the school, and each student would be enrolled precisely 





for the course length (ignoring travel time between the 


school and the gaining command) prior to the time they are 





needed in the fleet. This could be expressed as: 

Input; = Output; 

The ideal (4) input equals the required or ideal output 
in quantity, and 

Inputit = Outputiz —- course length 

The ideal input time (i+) is the course length prior to 


the required or ideal output time. 


However, this is not an ideal world. There will be 
students who do not complete the program for various 


reasons (e.g., disenrollment, discharge from the service, 





and death) and there are some students who will be delayed 
in their completion of the program (e.g., setbacks). Thus, 
the reality is such that either (1) the ideal output will 
not be achieved in quantity and timing, or (2) the inputs 


need to be adjusted to account for the quantity and timing 
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of outputs to meet the fleet requirement. The first 


situation could be expressed as: 
Output; < Output, and Outputit > Output 


The ideal output quantity is less than the real (,) 
output quantity and the required timing (+) of the receipt 


of those students in the fleet is not met (students arrive 





late). If this were to occur, the fleet requirement for 
capable Hospital Corpsmen would not be met and the cost of 


not having a capable Corpsman would be borne by the fleet. 
The second situation could be expressed as: 


Input; > Output; and Inputr, > Outputit- course 


length 


More students need to be enrolled in school to ensure 
the required quantity of graduates is available to reach 


the fleet at their required time. This will require 





students to be enrolled in school sooner than the minimum 
time required to complete the course prior to their 
required arrival in the fleet. This requires that the 


Hospital Corps School bear the cost of process delays and 





process attrition to ensure the fleet requirement is 


fulfilled. 


The purpose of the ARP is two-fold: 1) it ensures that 
only qualified Corpsmen reach the fleet (a gatekeeper 
function), and 2) it provides every Sailor the opportunity 
to reach his or her potential (a remedial function). The 


ARP is designed to minimize the difference between the real 





and ideal quantity of Corpsmen that reach the fleet (Output; 
and Output;) and the timing of their arrival in the fleet 


(Output; and Outputit). The gatekeeper effect, by the 
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nature of tighter controls, perpetuates Output, < Output; 
and Output; > Outputi~ unless input is increased. In that 
latter function, the remedial function requires more time, 
but it does allow a method to increase Output,, promoting a 
greater likelihood that it will shrink the gap between 


Output; and Output;. To understand the cost-effectiveness of 





the ARP, one needs to examine the costs of managing these 


differences in input and output and quantity and timing. 


Unfortunately, there is no control group without an 
ARP as a basis for comparison. It cannot be said that ARP 
reduces attrition since it is not known what attrition 
would occur if the ARP didn’t exist. Thus, it cannot be 
said that the existing ARP process produces savings of a 
specific amount. The analysis in this study can only 
establish a baseline of the costs to administer the ARP 
versus the cost of quantity and timing differences from the 
ideal. From an understanding of those costs, the school 
can then consider the economics of changes to the ARP: if 


the school spends more on a change to the process that 





results in less difference between the real and ideal, the 
cost of which can be computed to be more than before, was 
that change economical? This study will now address the 
formulation of those costs. 


2. Variable Indirect Cost 


In his 2001 study, Dr. Henry L. Eskew determined the 





cost of a Sailor is, “the money that would be saved by 
removing the Sailor—and his or her requisite support—from 
the force structure” (Eskew, 2001). Dr. Eskew’s study 


acknowledges the difficulties with properly identifying and 
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measuring costs that vary with the number of students in 


training. 


Using Dr. Eskew’s study as a guide, his concepts are 
applied to this thesis. The thesis area of interest is how 
annual training costs are affected by the decisions 
(setback or disenroll) of the ARP. Another way to state 
this is to look at training cost as a function of the 
number of students in the school and the cost of those who 
have been disenrolled. In this study, the number of 
students that pass through the school per year is 


determined by the number of HMs needed in the fleet and the 





time it takes to get them there. As the time to train 
increases and decreases, so will the number of people in 


training, which directly correlates to the costs of 





training. These are the indirect variable costs that are 
very difficult to estimate and would require advanced 


modeling techniques to find. 


Attrition rates determine the cost (more or less) of 





conducting training for a particular school, as well as the 
course length. Based on the variable costing model, 


variable cost per student should be used to compute 


changes. These costs do not affect the fixed costs of the 
school. 
3. Understanding the Nature of Cost 


When building the model, the cost of the ARP (ARP.) is 
a function (f) of numerous factors used to describe the 
output variable. These functions are changed to numerical 
attributes in a linear equation. This is accomplished by 


changing the function with the value wherever it appears in 
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the equation. The first output function describes the cost 


of the ARP. 
The functions can be stated as: 
ARP, = f (STi, At, Be, SMe, UNA.) 


ARP. is a function of the time instructors are away 
from teaching (STi), the administrative time of support 
staff members to prepare files (Ai), the time it takes to 
sit the board (Bi), and the cost on student motivation 
(SM.). Because behavior changes affect organizations, SM is 


very important in the effectiveness of the organization. 





The last function of the ARP. is the user needs assessment 
costs (UNA,). The assessment costs are the CO’s time and 


any support time provided by outside agencies (e.g., 





BUPERS, Medical, Family Services, etc.). These costs are 





based on the assessment services rendered while determining 
which students are able to complete training and which 
students are unable to complete training. The costs 
associated with the ARP are primarily opportunity costs and 


have very little to no real dollar cost. 


The second cost model considers the cost of less than 
ideal throughput. Costs which are related to both quantity 


and timing of students can be explained as: 
Oi = £ (Ir, Tet, Cre Crt, Car Caty Ore Ort) 


Achieving the ideal output (0;) is a function of both 
time and quantity due to the affects of the process. Those 
are, the cost of bringing in more than the ideal number of 
students (Ir); cost of bringing students in earlier (Ir); 
cost of lost work for rollbacks (Cr); cost of time lost for 


rollbacks (Cy); cost of lost work from attrition (Ca); cost 
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of time lost from attrition (Car); cost of failing to 
produce enough outputs (O,); and the cost of failing to 


produce the outputs on time (Oz). 


Identification of programs or interventions that 





decrease ARP. may help to increase the effectiveness of the 
ARP. This can be accomplished by implementing programs 
that help to increase student motivation, and through the 


utilization of models that better determine student 





ability. 


The very nature of the ARP has a negative impact on 
Oi, but its functions can create incremental benefits to 
the output. The economic goal is to balance costs, not to 
strive for input ideal (Ii) to equal throughput ideal (Oi). 
At its most economically efficient point, the marginal cost 
of the ARP should equal the marginal cost of the throughput 
model. That is, the next dollar spent on the ARP should 
provide a dollar benefit in improvement to the throughput 
model. If the dollar spent provides less than a dollar 
benefit, the school is spending too much on the ARP. If 
the next dollar spent on the ARP yields more than a dollar 
benefit, the school should expand the ARP until they reach 
equilibrium. 


4. Disenrollment Recommendation 


The cost discussion alone is aggravated by the cost of 
errors in the disenrollment decision process. If the ARB, 
Team, or DAD recommends the student to be disenrolled, the 
CO may agree or disagree. If the CO agrees and disenrolls 
the student, it’s possible the student may have been able 


to succeed. In this case the command incurs the cost of 
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disenrollment when the lower cost of setback would have 


been more appropriate. 


Likewise, the command continues to incur costs 


associated with training the student (except with an 





erroneous disenrollment), and until the effective 
disenrollment date it incurs the cost of setback and 
disenrollment. The command also incurs additional costs 
associated with training a replacement to fill the billet. 
The disenrollment of students who are capable of completing 
the training program is a realized sunk cost to the command 


that might not be recognized. 


When considering the disenrollment recommendations, 





the CO, as the ultimate deciding authority, must decide 
whether the student will complete the training. The CO 
commits a Type I error when he sets back a student who 
ultimately fails. Using Table 23, an example of this would 
be the 32 of 45 students recommended for disenrollment by 
the ARB but setback by the CO. These 32 eventually failed 
out of training. A Type II error occurs when the CO 
disenrolls a student that would have completed the 
training. Using the same ARB category in Table 23, this is 
the number of students that would have completed the 
training from the 88 that both the ARB and the CO agreed to 
be disenrolled. There is no way to determine how often this 


error is committed because the number of students that 





would have completed the training can not be ascertained. 


One hint at the number of Type II errors is available 
by looking at the ARB. The ARB committed a Type II error 
at least 13 times out of 133 times; these students had been 


recommended for disenrollment but were setback by the CO 
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and ultimately graduated. This is clearly an underestimate 


because there may have been other disenrollees who could 





have succeeded among the 88 the CO agreed to disenroll. 


From the cost formula perspective, the miscalculation 





based on the CO’s decision increases the cost of student 
throughput: O; = fF (Ir, It, Cry Crt, Cary Cat, Or, Ort). Under 
a Type I error, setback students who ultimately fail, the 
following variables increase: Cr, Cre, Ca, Cat, Or, Ort. A 
Type II error, disenrolled students who would have 
completed training, causes the following variables to 
increase: Ir, Ire, Ca, Cat, Or, Ore. The goal of the command 
would be to decrease costs by finding ways to lessen the 
occurrence of these errors. 


5. Conclusion 


To determine the efficiency of the process, the model 





should focus on the school’s training throughput cost and 
the cost of the ARP. To improve efficiency, the school 


will need to achieve better results with the same costs or 





by lowering costs. The study anticipates the existence of 





a linear relationship between the two outputs. Also, a 
student’s motivation and morale are hard variables to 


quantify, but they need to be acknowledged in the analysis 





of cost-effectiveness. In addition, future research should 
consider a follow-up study of all students who experienced 
the ARP to see if they completed their contracted length of 


service. 
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V. CONCLUSIONS AND RECOMMENDATIONS 


This thesis analyzed the Academic Review Process at 


the Hospital Corps “A” School, specifically focusing on its 





effectiveness and the criteria of the Academic Review 
Board. This was accomplished by analyzing a data 
spreadsheet of students who went through the ARP in 2003 
and a survey randomly administered to a general student 
sample in January 2004. The study identified and analyzed 
the perceptions of students, instructor staff, and 
headquarters staff in the evaluation of the processes. The 
data set was analyzed by cross-referencing the 


recommendation and final disposition results of those 





students who entered the ARP. Finally, a cost framework 
was developed for the “A” School command and future 


researchers to help determine the effectiveness of the 





process. 


A. CONCLUSIONS 


The ARP is working well but like any other process, 





there are areas that can be improved upon. Four broad areas 
have been identified to explain how well the ARP is working 
and to show where improvements can be made. The first area 
details communication issues the command has with regards 
to the academic review process. The next area looks at the 
differing perceptions between the two student groups and 
the staff. The third area deals with how the three groups 


view the ARB. The final area explains the effectiveness of 





the ARP. The conclusions drawn from the results follow: 
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1. Communication Issues 


There is a slight difference in the perception of the 





effectiveness of communication between students and the ARP 
chain of command. All students have issues with the 
channels of communication up the chain of command and Non- 
ARB students have problems with the feedback mechanisms 


available to them. Specific conclusions include: 


e Many students didn’t feel comfortable communicating 
with the Headquarters chain of command. This may be 
because the students have not been explicitly 
informed that an open door policy exists at that 
level. (p.38) As set forth by guidelines in the Navy 
School Management Manual (NAVEDTRA 135A, 2000), 
which outlines counseling procedures to be in place 
at training commands for student pipeline 
management, it is important for students to know 
that communication channels are established, 


maintained, and available. 


e Students in the non-ARB group report that only two 
of the eight communication mechanisms are useful or 
very useful (class discussions with instructional 
team and peer-to-peer interactions). There is no 
material noted in the literature review that relates 
to what effect feedback and communication have on 
academic disenrollment. However, understanding the 
importance of communication and feedback in any 
command, and finding appropriate mechanisms to meet 


the needs of the command are important. 
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2. Differing Perceptions 





There are differing perceptions between the Non-ARB 
students, ARB students and staff regarding the ARP. 


Specific conclusions include: 


e The staff believes that all of the feedback and 
communication mechanisms are useful or very useful 
(class discussions with instructional team, informal 
feedback through instructors, peer-to-peer 
interactions, course/instructor evaluations, 
informal feedback through instructional team 
members, informal feedback through DIVO, surveys, 
and Captain’s Call). As reported in the 
communication section above (2.b.), students in the 


non-ARB group had a different perception. Students 





in the ARB group agreed with the non-ARB group but 
also report that an additional three mechanisms are 
useful or very useful (informal feedback through 


instructors, course/instructor evaluations, and 





surveys). (p.39) The differences between the student 
groups can probably be attributed to ARB students 
having more staff interactions due to the academic 


review process. 


The differences between the student groups and 





the staff are not surprising. For the staff 


members, experience when dealing with these 





mechanisms and the military maturity level of the 
respondents can be used to explain the differences. 
This statement does not suggest that staff members’ 


perceptions are totally correct, but that the 
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results most likely involve an advance understanding 


of the different mechanisms. 


There are differences between staff and students in 





the perceived fairness of the ARB decision process. 
(p.52) Reflected in the negative qualitative 
comments, the implications of this perception to 
morale and motivation demonstrated a sense of 
intimidation and unfairness from the ARB process. A 
2001 CNA study (Moore & Reese, 2001) looks at 
attrition rates and identifies some predictors of 
initial skills training completion. The study found 
that students’ perceptions of rating, education, 
waivers, delayed entry program, and rating 
assignment, as well as school management, were 
factors in explaining attrition. Standing before 
the ARB is not a pleasant experience, but it helps 
to provide motivation or to identify those students 
with the desire and ability to continue training. 
Because of the small number of students surveyed in 
this study, the findings do not conclusively predict 
training completion, but do suggest a possible 
relationship between school management and “A” 


school completion. 


There is a lack of agreement among staff regarding 
which recommendations carry the most weight in the 
CO’s decision to retest/retain, setback, or 
disenroll. (p. 51) Clear goals and objectives of the 


different entities in the ARP are not established. 





There are differences between staff and students 


with regards to the participation of Class Advisors 
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and Team Leaders as representatives on the ARB 
(e.g., ARB students generally prefer this option, 
while the staff does not). (p.54) There are not 
enough data to draw specific conclusions about this, 


but it should be addressed in further research. 


There are differences between ARB and Non-ARB 





students in what topics are addressed during 
counseling after test failures, and in the 
interventions used, and the usefulness of those 


interventions. (Tables 6, 7 & 8) Although these 





differences are probably attributable to a much 





smaller percentage of Non-ARB students with one or 
more test failures, they are still noted. The 
results may indicate that students take matters 
seriously only during the part of the ARP where they 


first can be recommended for disenrollment. 





The Non-ARB student group found it easier to 
communicate with headquarters staff than the ARB 
student group. (42) Students from the ARB group 
maybe less likely to communicate with the chain of 


command because they feel intimidated by the 





headquarters staff, and that any communication with 
the headquarters staff may be unfavorable for them 
individually. 


ARB 


Most elements and processes of the ARB are understood 


by the groups that come into contact with it but the 


application of criteria used to assist the student through 


the processes differ among the groups (reported in 2.b. and 


2.d. above). Specific conclusions include: 
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There is agreement among staff and ARB students on 
the factors considered by the ARB when making 
recommendations to retest/retain, setback, or 
disenroll. (p.50) All groups know what factors the 


ARB value when making its recommendation. 


Slightly more than half of the ARB student group did 
not use the rebuttal process, but of the 14 students 
who did use the rebuttal process, 12 of them found 
it useful. (p.56) Students do not know the factors 
that the CO’s decision is based on, nor, apparently, 
do they understand the value of the rebuttal 
process. 


Effectiveness of the ARP 


The basic framework of the ARP is established and 


effective. Its objective is to provide those students with 


academic challenges the tools necessary to succeed in the 


training. Specific conclusions include: 


Based on the differences in final determination made 
by the ARB and CO, the following conclusions are 


inferred. The objective of the staff is to identify 





Sailors who do not have the potential to be 
successful HMs in the Fleet, while the CO’s 
objective is to provide every opportunity for 
Sailors to successfully complete the training. (p. 
65) This conclusion relates to the study that 
supports initiatives to provide a second chance at 
school (Quester, Macllvaine, Barfield, Parker, and 
Reese, 1998). The study noted that Sailors were more 
successful when provided a second chance, which 


relates to the CO providing more chances to complete 
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training. This suggests a contributing explanation 
for the CO’s willingness to make a Type I error, 


where a setback student ultimately fails. (p.73) 


Students are satisfied with the guidance provided 
for test preparation and consistency of instruction. 
(p.44) Staff generally felt they had sufficient time 


available to provide assistance outside of class 





hours. (p.46) The CNA study by Belcher, Reese, and 
Lewis (1999) focused on initiatives that improve the 
delivery of Sailors to the fleet. Students’ 
satisfaction with course delivery and preparation, 
and the time that instructors were available outside 
of class were noted as key correlates to improving 


student performance. By reference to initiatives 





that improve the delivery of Sailors to the fleet, 
the HM “A” school staff and student satisfaction 


with intervention procedures through the ARP 





suggests they are related to student success. 


RECOMMENDATIONS 


The following recommendations are based upon the 


analysis and conclusions of this thesis: 


Establish and communicate clear goals. These goals 
should acknowledge if the intent of the ARP is to 
provide a second chance, limit cost, or reduce the 
attrition rate. A few ways these specific goals may 
be answered is by giving more students more chances 
(setbacks and retentions); trying to decrease costs 


by finding ways to accelerate the early elimination 





of likely failures; or determining if more 





aggressive interventions prior to the third test 
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failure have a positive relation to the attrition 
rate. Ensure that the goals of the command’s ARP 
policies and standards are applied to align with the 
command’s mission and vision. Ensure that the 
goal(s) are promulgated to the staff and students so 
everyone will know what the ARP is designed to 
address, why it is so designed, and how it will meet 


that goal. 


Increase training between headquarters staff and 
instructor staff (all ARB members) and establish 
standard criteria for ARB members when sitting on a 
board. Center the training on the ARP processes and 
factors that influence decisions. This will help to 
ensure that the staff understands all policies and 
procedures of the process and that an equitable 


standard is applied to all students. 


Review quarterly (or biannually) ARP decision trend 
analyses (periodic reinforcement of goals). Ata 
minimum these data should track attrition rates and 
review/discuss consensus recommendations for setback 
and disenrollment as presented in Tables 22 and 23. 
Promulgate these data to the command so it can see 
and understand the processes of the ARP and follow 
how it is working, and take corrective action when 


warranted. 


Consider having top students (volunteers) share 
their school experiences with incoming students. 
This can be done via small group meetings, lecture, 
or one-on-one. This will help personalize standards 


and may instill school pride in the students. Some 
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senior students currently fill this role. ARB 


students valued the usefulness of student tutors; 





therefore, this type of interaction may help bridge 
some of the gaps between student and staff 


perceptions. 


Create and have all students sign an ARP training 
statement during orientation training. The 
statement should address the specifics (e.g., what 
it is, test failure significance, rebuttal process, 
open-door policies, etc.) of the academic review 
process. This will help to impress the significance 
of the ARP on the students and may clarify 
understanding by facilitating communication (student 


questions and answers). 


Determine if feedback opportunities between students 
and headquarter staff need to be increased to 
promote dialogue. This could give headquarters 
staff a better feel for the pulse of the command 
while helping to engage and influence student 


interactions. 


Determine the benefit and then decide if the command 





should allow the student to be accompanied by 





his/her Team Leader or Class Advisor to the ARB when 
necessary. As reported in Table 20, half the ARB 
students and staff responded in support of this. 
This could be a potential benefit to the ARP by 


strengthening the ARB and its recommendations. 


Determine if a regular student assessment of 


instructional staff is of value to the command. TE 
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decided to be valuable, impress upon students the 
desirability and anonymity of honest critiques. 
Results could then be analyzed for trends that 
indicate which instructors the students’ rate most 
highly. Instructors with high ratings could then be 
used to give instructional briefs during staff 
training sessions. This could help communication and 
give appropriate credence to the perceptions of 
processes. 


Cc. FUTURE RESEARCH 


During the analysis of data in this thesis, some 
limitations were identified. Necessary data to perform 
cost calculations were unavailable at the time of this 
study. Data for Corpsman performance, one year after “A” 
school, were not available that would have allowed us to 
compare the two student groups (ARB and Non-ARB). This 
thesis does not focus on which communication and feedback 
mechanisms are more useful than others, nor does it try to 
identify other mechanisms that might be useful. The 


following recommendations for future research are provided: 


e Collect data and examine the costs of conducting the 
ARP and its decisions in future studies using the 


framework provided in Chapter IV. 


e Examine the performance of Corpsmen who had three or 
more test failures, but ultimately graduated, after 
they have been out of “A” School for approximately 
one year. Their performance should be compared with 
Corpsmen with less than two test failures to 
determine if there are performance differences. This 
information would be useful in evaluating the two 
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potentially competing criteria to be used through 
the ARP; to assure quality on the job (gate-keeping) 
and to increase the opportunity to graduate 


(remedial). 


Sponsor a study that identifies the feedback and 
communication mechanisms that would be useful and 
utilized by students and staff to relay concerns up 


and down the chain of command. 
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APPENDIX A. STUDENT INTERVIEW QUESTIONS 


1. Does the academic review process foster interventions, 
leading to enhanced student learning? 
Probing question: Describe the type(s) of interventions 


that you have received? 


2. Does the academic review process foster open 
communication? 

Probing question: If you are experiencing academic or non- 
academic problems, how do you relay this to your chain of 


command? 


4. How does the academic review process provide support to 
students dealing with non-academic issues? 


Probing question: What resources are available to you? How 





and when are these resources made known to you (i.e., 


orientation, and counseling? 


5. How do new students learn about the academic review 
process? 
Probing question: Is the ARP process explained during 


orientation? If not, when? 


6. After your first test failure what type of intervention 
did you receive? 

Probing question: What interventions did you receive at the 
team level? What interventions did you receive at the 
Division Officer level? After your second test failure what 


type of intervention did you receive? 
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7. What guidance are you provided for test preparation? 
Probing question: Is there sufficient opportunity to 


receive assistance outside of class times? 


8. If you could improve one component of the ARP, what 


would it be and why? 
Probing question: Tell me about a time when the process 


worked well? Tell me about a time when the process failed? 
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APPENDIX B. STUDENT SURVEY 


STUDENT SURVEY, page 1 


This information in no way will be used to identify individuals. It is 
for statistical purposes only. 


Individual Characteristics 

1. Are you male or female? 

[A] Male [B] Female 

2. What is your current age? 

[A] 21 or under [B] 22-26 [C] 27-30 [D] 31-36 


3. As of today, what is the highest level of education you have 
completed and received credit? 


[A] High School Diploma [B] GED [C] Some college [D] AA Degree [E] 
BA Degree or higher 


4. What is your current marital status? 
[A] Married [B] Separated [C] Divorced [D] Single 


5. Do you have children? If yes, how many children do you have? 
Indicate by circling the number. 


[A] Yes [B] No 1 2 3 4 5 or more 
6. What is your race? 


[A] White {[B] Black [C] Hispanic [D] Asian [E] Other 
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STUDENT SURVEY, page 2 
Military Information 
7. What is your pay grade? 
[A] El [B] E2 [C] E3 [D] E4 [E] E5 or above 
8. How long have you been on active duty? 
[A] Less than 1 year 
[B] 1 or more years but fewer than 3 years 
[C] 3 years or more 
9. How long have you been a student at Corps School? 
[A] Less than 1 Month 
[B] 2-3 Months 
[C] 4-5 Months 
[D] 6 Months or longer 
10. Through which method did you receive your assignment to “A” school? 
[A] Recruiter-guaranteed “A” School 
[B] Recruit training classification 
[C] Striker 
11. Did you choose the Hospital Corps rating? 
[A] Yes [B] No 
12. How many test failures have you had? 
[A] 1 EBA 2 GH 3 [D] more than 3 


13. Have you been before the Academic Review Board? 


[A] Yes [B] No 
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STUDENT SURVEY, page 3 
Strengths and Weaknesses of the Academic Review Process 


14. (a) After your first test failure what intervention(s) did you 
receive? 
x (all that apply) 

[A] Night study | 

[B] Student tutor { ] 

[C] Test taking tips [ ] 

[D] Help from a staff member { ] 

[E] Other 


(b) On a scale of usefulness, how would you rate the interventions 

that you used? 
Not At All Useful Very Useful 

[A] Night study [ [ ] 
[B] Student tutor 
[C] Test taking tips 
[D] Help from a staff member 
[E] Other 


[ ] 
[ ] 


(os os Bl oe oe 
rr or re 
a 
(en Ol os Bl ee i oe 
a 


[ 
[ 
[ 
[ [ ] 
15. (a) After your second test failure what intervention(s) did you 
receive? 

x (all that apply) 

[A] Night study [ 
[B] Student tutor [ 
[C] Test taking tips [ 
[D] Help from a staff member [ 
[E] Other [ 


a a 


(b) On a scale of usefulness, how would you rate the interventions 

that you used? 
Not At All Useful Very Useful 

[A] Night study [ [ ] 
[B] Student tutor 
[C] Test taking tips 
[D] Help from a staff member 
[E] Other 


Ld 
[ed 


(en El es Bee oe ee) 
ee or 
a ee) 
(en ls Bee ll oe ee) 
a ee) 


[ 
[ 
[ 
[ 
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i 
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STUDENT SURVEY, page 4 
Strengths and Weaknesses of the Academic Review Process 


16. After your first or second test failure were you counseled in 
regard to the following items listed below? 

x (all that apply) 
[A] Your interest in being a HM [ 
[B] What you need to know for tests 
[C] Why what you are learning is important in the rating 
[D] Other rating options 
[E] Stress Management techniques 
[F] Study techniques 
[G] Test taking tips 
[H] School resources (i.e. tutoring, night study) 








(ee Bl oes Bl oes Bl oe cee De 
ee ee ee ee ee ee) 


17. Which of the following feedback mechanisms are available to you to 
relay concerns to your chain of command related to academic or non- 
academic issues. 

x (all that apply) 
[A] Surveys [ 
[B] Discussions with instructional team (Members: HMC, HM1,HM2) 
[C] Course/instructor evaluations 
[D] Informal feedback thru instructional team leader (DIVO) 
[E] Informal feedback thru instructors 
[F] Informal feedback thru instructional team members 
[G] Captain’s Call 
[H] Peers 
[I] None 


ee ee ee ee ee ee) 


[ 
[ 
[ 
[ 
[ 
[ 
[ 
[ 


18. On aescale of usefulness, how would you rate the feedback 
mechanisms that you have used? (leave blank if you have not used this 
feedback mechanism) 

Not At All Useful Very Useful 
[A] Surveys Fo] [ ] [ ] [ ] 
[B] Discussions with 
INST team members [ ] | [ ] [a] 
[C] Course/instructor evaluations | [ ] [ ] [al 
Informal feedback 
thru INST team leader [ ] [ ] [ ] [ ] 
[E] Informal feedback thru instructors [ ] [ ] bal [ ] 
[F] Informal feedback 





thru INST team members [ ] [ ] [ ] [ ] 
[G] Captain’s Call [ ] [ ] [ ] [ ] 
[H] Peers fed [ ] [ ] 4 
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STUDENT SURVEY, page 5 
Strengths and Weaknesses of the Academic Review Process 


19. (a) Which of the following staff members have made an open door 
policy known to you? 


x (all that apply) 
[A] INST Team (Members: HMC, HM1, HM2) 
[B] Instructors 
[C] INST Team Leader (DIVO) 
[D] Senior Enlisted Leader (HMCS) 
[E] DIR of Academics 
[F] Deputy DIR of Academics 
[G] DEPT Head 
{[H] XO and CO 
[I] Chaplain 


(oe i ees Bs Bl oe Bl oe Ol es ee 
ee ee a ee ee ee 


(b) How easy do you feel it is to communicate problems or concerns 
with each of the following: 


Very Difficult Very Easy 

[A] INST Team 

(Members: HMC, HM1, HM2) 
[B] Instructors 
[C] INST Team Leader (DIVO) 
[D] Senior Enlisted Leader (HMCS) 
[E] DIR of Academics 
[F] Deputy DIR of Academics 
[G] DEPT Head 
{[H] XO and CO 
[I] Chaplain 


Es en en Bos oe oe ee Be 
ee ee ee 
(in en re os Ol oe ee ee Be 
ee ee ee ee 
(os A es en Bt os Ol oe oe ee Be 
a ee ee ee ee 
(sn Be Bt oes oe oe ee Be 
Pe ee ee ee 
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STUDENT SURVEY, page 6 
Strengths and Weaknesses of the Academic Review Process 


20. On a scale of helpfulness, rate the following staff that you have 
used. (Leave a specific resource rating blank if you haven’t used it) 


Not At All helpful Very helpful 

[A] INST Team 

(Members: HMC, HM1, HM2) 
B] Instructors 
C] INST Team Leader (DIVO) 
D] Senior Enlisted Leader (HMCS) 
E] DIR of Academics 
F] Deputy DIR of Academics 
G] DEPT Head 
[H] XO and CO 
[I] Chaplain 
[J] Family Service Center 


[ 
[ 
[ 
[ 
[ 
[ 





[ee nen Be Be Be ce Be Be ee] 
a ee ee ee ee ee) 
Le A en Bes Be ee ee ee Be ee 
ee ee ee ee ee 
Lo en Be Be Be ce ee Be ee 
a ee ee ee ee ee 
[en een Bs Be Be ce Be Be ee 
ee ee ee ee ee) 


21. Do you understand the academic review process? The academic review 
process encompasses, but is not limited to the following: 
communications procedures (i.e., Course/instructor evaluations, 
Captains Call) available to students to voice concerns and problems; 
interventions (i.e., night study, tutors, test taking tips) available 
to students experiencing academic or non-academic problems; 
availability to receive guidance and assistance from staff outside of 
class hours; and student awareness and understanding of the role of the 
academic review board. 


[A] Yes 
[B] No 
22. Rate your understanding of the academic review process. 


No Understanding at All Strong Understanding 
[ ] [ ] [ ] El 
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STUDENT SURVEY, page 7 


Strengths and Weaknesses of the Academic Review Process 


(a) When was the academic review process first explained to you? 


23. 
x One Only 


[A] Orientation [ ] 
[B] After your first test failure ae 
[2] 


[C} After your second test failure 


(b) Rate your impression of the ARP? 
Not At All Useful Very Useful 
] [ ] 


[ ] [ ] [ 








Why? 
24. (a) Are you provided guidance for test preparation? 
[A] Yes 
[B] No 
(b) Rate the guidance you receive for test preparation? 
Not At All Useful Very Useful 
[ ] [ ] [4 [ ] 
Why? 
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STUDENT SURVEY, page 8 


Strengths and Weaknesses of the Academic Review Process 


25. Is there sufficient opportunity to receive assistance outside of 
class time? 


[A] Yes 
[B] No 
(b) Rate your satisfaction of the opportunity provided to you to 


receive assistance outside of class time? 


Not At All Very Satisfied 
Satisfied 
[ ] [ ] bed bed 


Why? 








26. Do you feel that there is consistency between what instructors 
teach and what you are expected to know for a test? 


[A] Yes 
[B] No 


(b) Indicate if either or both of the following are not consistent 
with what you are expected to know for a test. 
X the one that applies 


[A] Written tests 


[ 4 
[B] Practical lab applications | 
[C] Both [ ] 


27. When called before the ARB should your class advisor accompany you 
to the board? 


[A] Yes 
[B] No 
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STUDENT SURVEY, page 9 


Academic Review Board 


28. When called before the ARB should your class advisor be a 
representative on the board? 


[A] Yes 
[B] No 


29. When called before the ARB should your team leader accompany you to 
the board? 


[A] Yes 
[B] No 


30. When called before the ARB should your team leader be a 
representative on the board? 


[A] Yes 
[B] No 


31. Indicate which of the following you have experienced regarding an 
ARB? 
x (all that apply) 


[A] Positive reinforcement 

(i.e. conveyed belief/faith in you) 

[B] Threats/Intimidation/Hostile environment 

[C] Positive (environment: encouraging) 

[D] Negative (environment: harsh, critical, likely to fail) 
[E] Offer of assistance 

[F] Refusal of assistance 


Cn een Bees Bee Bl ee 
ee ee 


32. Rate the extent to which you feel ARB members have’ the 
“right”/complete information for making decisions about retest/retain, 
setback or disenrollment? 


To A Great Extent To No Extent 


[ ] [ ] [ ] [ ] 


What information do you feel is missing? 
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STUDENT SURVEY, page 10 


Academic Review Board 


33. Did you know you had an option to submit a rebuttal? 


[A] Yes 
[B] No 


34. Did you use the rebuttal option? 


[A] Yes 
[B] No 


35. Was it useful? 


[A] Yes 
[B] No 


Why? 








36. Rate each of the factors below in terms of how much you think each 
is considered by the ARB determining whether to recommend setback or 
disenrollment of a student? 


Not At all Very Important 
Considered in Decision 


[A] Student Motivation [ ] | [ ] [ ] 

[B] Information provided 

by team leader 

Documentation of night study 

Class participation 

Information provided by tutor 

Student ability to 

produce class notes [ ] 

[G] Test scores [ ] 

[H] Number of tests failed ie 
[ ] 
[ ] 





[I] Practical performance 
[J] Other 
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STUDENT SURVEY, page 11 


Academic Review Board 


37. Overall, do you see the ARB decision process as being fair? 


[A] Yes 
[B] No 


38. Rate the fairness of the academic review process. 


Not At All Fair Very Fair 


[ ] [ ] [ ] [ ] 


39. How does the perceived fairness or unfairness affect your 
motivation? 
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STUDENT SURVEY, page 12 
Student Recommendations 


1. If you could improve one component of the ARP what would it be? 








Why? 








2. What in the academic review process has benefited you the most? 








Why? 








3. What in the academic review process has benefited you the least? 








Why? 
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APPENDIX C. STAFF SURVEY 


STAFF SURVEY, page 1 


This information in no way will be used to identify individuals. It is 
for statistical purposes only. 


Military Information 


1. What is your pay grade? 

[A] E5 [B] E6 [C] E7 or above [D] 01 [E] 02 [F] 03 [G] 04 or above 

2. How long have you been assigned to Hospital Corps School? 

[A] Less than 6 Months [B] 7-9 Months [C] 1 Year [D] more than 1 Year 
3. What is your job position? 

[A] Instructor 

[B] Executive Staff (i.e. DIVO, Deputy DAD, DAD, XO, CO SEL) 

[C] Instructional Team Member 


4. Have you been a member of an ARB? 


[A] Yes 
[B] No 


5. How many ARBs have you been a member of? 


[A] 1 [B] 2 [Cc] 3 [D] (fill in blank) 


103 


STAFF SURVEY, page 2 


Strengths and Weaknesses of the Academic Review Process 


6. On a scale of usefulness, how would you rate the feedback 
mechanisms available to students [to relay their concerns to their 
chain of command]? (Leave blank if never used) 


Not At All Useful Very Useful 
[A] Surveys [ ] [ ] [ ] [ ] 

[B] Class discussions 
with INST team members [ ] [ ] [ ] [ ] 

[C] Course/instructor 
evaluations Les] [ ] [ ] [ ] 

[D] Informal feedback 
thru INST team leader [ ] | Es [ ] 

[E] Informal feedback 
thru instructors [ ] [ ] [ ] [ ] 

[F] Informal feedback 
thru INST team members [ ] [ ] ee [ ] 
[G] Captain’s Call Lod [ ] Ed [ ] 
[H] Peers [ ] fel I] [ ] 


7. Does the school have an open door policy? 


[A] Yes 
[B] No 


8. (a) When is the academic review process first made known to a 
student? 


x One Only 
[A] Orientation as 
[B] After first test failure fed 
[C} After second test failure [ ] 


(b) On a scale of usefulness, how do you think students perceive 
the ARP? 


Not All Useful Very Useful 
[ ] [ ] [ ] [ ] 


Why? 
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STAFF SURVEY, page 3 


Strengths and Weaknesses of the Academic Review Process 


9. Do you have sufficient opportunity to provide assistance to students 
outside of class time? 


[A] Yes 
[B] No 


If sufficient time is not available, what are causal factors: 








Academic Review 


10. Do you feel 
board? 


[A] Yes 
[B] No 


12. Do you feel 


representatives 
[A] Yes 
[B] No 


13. Do you feel 
board? 


[A] Yes 
[B] No 


14. Do you feel 
on the board? 


[A] Yes 
[B] No 


Board 


student class advisors should accompany students to the 


student class advisors should be student 


on the board? 


student team leaders should accompany students to the 


student team leaders should be student representatives 
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STAFF SURVEY, page 4 


Academic Review Board 


15. 


(a) Do you feel the ARB is provided the “right”/complete 


information necessary for making decisions about retest/retain, setback 
or disenrollment? 


[A] 
[B] 


16. 


[A] 
[B] 


17. 


Yes 
No 


(b) If no, what information do you feel is missing? 





Are students told of their option to submit a rebuttal? 


Yes 
No 


Rate each of the factors below in terms of how much you think each 


is considered by the ARB in determining whether to recommend setback or 
disenrollment of a student? 


(en i en Bee 





[B] 


Not At All Very Important 
Considered In Decision 


Student Motivation [ ] [ ] [ ] [ ] 
Information provided 

by team leader 

Documentation of night study 
Class participation 
Information provided by tutor 
Student ability to produce 
class notes 

Test scores 

Number of tests failed 
Practical performance 

Other 


fn il een Bien ee 
a 
(en il en Ben ee 
a 
fn iil oes Ben Be 
a 
(en iil een Ben ee 
i 


(es il es Ble oe ee) 
a ) 
(el es Ble ll oe 
eo re) 
(en El es Ble le ee 
a ee) 
(el es Ble oe ee) 
a 





Overall, do you see the ARB decision process as being fair? 


Yes 
No 
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STAFF SURVEY, page 5 


Academic Review Board 


19. 


How does the perceived fairness or unfairness affect your 


motivation to be a board member? 

















20. Whose recommendation does the ARB weigh more heavily? 
X (ONE) 

[A] Team Leaders eee 

[B] Instructors Ls 

[C] Division Officer [ ] 

[D] Senior Enlisted Leader [ ] 

Why? 

21. Whose recommendation do you feel the CO weighs more heavily? 
X (ONE) 

[A] ARB [ ] 

[B] DAD [ ] 

[C] XO [ ] 

Why: 

22. Do attrition and retention factors influence your decision? 

[A] Yes 

[B] No 


(b) If yes, rate the degree to which your recommendation is 


influenced by these factors. 


To No Degree Very Important to Decision 


[ ] [ ] [ ] [ ] 
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STAFF SURVEY, page 6 


Staff Recommendations 


1. If you could improve one component of the Academic Review Process, 
what would it be? 








Why? 





2. What do you feel is missing from the academic review process? 
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